-- Logs begin at Fri 2021-08-27 03:09:41 UTC, end at Fri 2021-08-27 04:32:54 UTC. -- Aug 27 03:43:31.193546 dv-cinder-804757-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 03:43:31.204391 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:43:31 2021] *** Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: nodename: dv-cinder-804757-2-iscsi Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: machine: x86_64 Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: clock source: unix Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: pcre jit disabled Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: detected number of CPU cores: 4 Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: current working directory: / Aug 27 03:43:31.206442 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: your processes number limit is 47680 Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: your memory page size is 4096 bytes Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: detected max file descriptor number: 2048 Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: lock engine: pthread robust mutexes Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: thunder lock: enabled Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 03:43:31.207054 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:43:31.253481 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: Python main interpreter initialized at 0x55e72377e9c0 Aug 27 03:43:31.253481 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: python threads support enabled Aug 27 03:43:31.253481 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: your server socket listen backlog is limited to 100 connections Aug 27 03:43:31.253481 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:43:31.253816 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:43:31.253816 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: *** Operational MODE: preforking *** Aug 27 03:43:31.254111 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:43:31.254111 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: spawned uWSGI master process (pid: 73780) Aug 27 03:43:31.254317 dv-cinder-804757-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 27 03:43:31.255721 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: spawned uWSGI worker 1 (pid: 73792, cores: 1) Aug 27 03:43:31.255721 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: spawned uWSGI worker 2 (pid: 73793, cores: 1) Aug 27 03:43:31.255721 dv-cinder-804757-2-iscsi devstack@keystone.service[73780]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:43:36.381505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:43:36.381505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: from cryptography.utils import int_from_bytes Aug 27 03:43:36.382269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:43:36.382269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: from cryptography.utils import int_from_bytes Aug 27 03:43:36.382729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:43:36.382729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: from cryptography.utils import int_from_bytes Aug 27 03:43:36.382828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:43:36.382828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: from cryptography.utils import int_from_bytes Aug 27 03:43:36.431331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:43:36.431563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:43:36.431677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:43:36.431789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:43:36.431881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] command line args: [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:43:36.431988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] command line args: [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:43:36.432066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:43:36.432285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:43:36.432375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ================================================================================ {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:43:36.432444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ================================================================================ {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:43:36.432514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] admin_token = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.432622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] admin_token = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.432729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] config_dir = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.432799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] config_dir = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.432862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.432921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.432981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] config_source = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.433038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] config_source = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.433100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] debug = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.433163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] debug = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.433370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_config_append = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_config_append = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.436954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_dir = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_file = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_dir = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_file = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.437827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.438886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.439001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.439110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.439528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.439664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.439664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] publish_errors = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.439894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] publish_errors = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.440941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] standard_threads = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] use_journal = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.441950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] use_json = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.442031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.442123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] use_stderr = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.442297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] use_syslog = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.442429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] standard_threads = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.442521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.442816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.442931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.443054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.443268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.443353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.443535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.443613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.443784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.443870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] use_journal = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.444017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.444137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] use_json = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.444262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.444428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] use_stderr = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.444513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.444717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] use_syslog = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.444796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.444962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.445113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:43:36.445196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.445431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.445545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.445672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.445905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.446893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.447127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.447242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.447361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.447611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.447689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.447870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.448984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.449059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.449278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.449362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.449536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.449780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.450660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.450871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.450958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.451921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.452901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.453989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.454193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.454272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.454439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.454666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.454764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.454926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.455945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.456091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.456306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.456385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.456550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.456706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.456797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.457944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.458987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.459146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.459316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.459399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.459634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.459747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.459880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.460115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.460217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.460360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.460595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.460673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.460827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.461956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.462977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.463164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.463343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.463422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.463611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.463773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.463850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.464068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.464154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.464313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.464546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.464624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.464861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.465050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.465139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.465347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.465513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.465669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.external = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.465930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.466023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.466365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.466453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.466635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.466850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.466928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.password = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.467088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] auth.token = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.467237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.467318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.467550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.467651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.467795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.468844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.469956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.470103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.470181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.470417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.470550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.470806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.470979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.471058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.471285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.471410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.471540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.471829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.471915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.472085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.472262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.472340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.472582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.472729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.472834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.473060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.473176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.473297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.473559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.473637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.473808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.474944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.475965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.476121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.476199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.476453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.476539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.476690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.476925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.477874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.478125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.478203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.478358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.478599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.478695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.478832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.479917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.480993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.481183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.481274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.481555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.481696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.481934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.482902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.483134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.483220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.483381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.483614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.483691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.483857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.484856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.external = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.485954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.486033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.486201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.486446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.486524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.486702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.486923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.password = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] auth.token = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.487871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.488911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.489974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.490938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.491148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.491276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.491392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.491636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.491714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.491881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.492965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.493052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.493280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.493358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.493511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.493742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.493956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.494954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.495172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.495258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.495404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.495636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.495721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.495869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.496111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.496190 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.496349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.496557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.496644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.497340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.497516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.497599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.497849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.497968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.498058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.498293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.498371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.498540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.498810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.498889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.499968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] role.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] role.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500422 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.500917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.501072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.501151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.501392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.501527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.501637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.501880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.502916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.503858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.504986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.505966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.506959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.507955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.508928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.509991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.510986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.511927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.512014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.512153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.512231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.512445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.connection = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.513945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514908 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.514998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.515968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.516939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.517875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.518032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.518113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.518203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:43:36.518282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.518499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.518765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.519008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.519265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.519516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.519765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.520014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.520262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.520495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.520743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.520980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.521216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.521451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.521686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.522022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.522274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.522515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.522797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.523031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.523279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.523516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.523789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.524822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.524822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.524822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.524822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.525109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.525228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.525386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.525632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.525869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.526121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.526370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.526629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.526880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.527120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.527365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.527602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] role.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.527850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] role.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.528117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.528416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.528687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.528937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.529188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.529436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.529683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.529935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.530185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.530421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.530739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.530996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.531244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.531495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.531927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.532169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.532420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.532671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.532921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.533173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.533409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.533667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.533917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.534157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.534391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.534741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.534883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.535136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.535392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.535643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.535882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.536120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.536352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.536593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.536829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.537077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.537317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.537653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.537823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.538065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.538325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.538587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.538848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.539086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.539323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.539566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.539809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.540063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.540295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.540542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.540805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.541076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.connection = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.541320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.541569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.541809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.542318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.542567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.542826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.543065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.543306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.543552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.543846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.544087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.544338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.544663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.544907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.545154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.545388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.545629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.545867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:43:36.546038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:43:36.548321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.548551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.548777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.557285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.572043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.572247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.572481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.581630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.586515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.586774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.600887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.601115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.642164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.646672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.692040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.692273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.692847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.693085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.759766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.759969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.760987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.870834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.871925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.872033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.872142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.872236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.872519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.883610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.883749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.897966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898141 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73793) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.898793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:43:36.916165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.916371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:43:36.916568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.916708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.916794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:43:36.917178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:43:36.917373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.917455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.917577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:43:36.917668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.917844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.917924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.918105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.918185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.918360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.919188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.929869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.929989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.930150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.930268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.930412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.930537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.930709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.930851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.939481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.939794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.942701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.942979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.943060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.943260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.943341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.943539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.943620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.943816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.943897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944338 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.944955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.945133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.945221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.945397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.945478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.945661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.971522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.971777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.973018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.973297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.973383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.973639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.978595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.978837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.978980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.979116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.979250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.979515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.986886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.987161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.987250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.987481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.991504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.991790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.991898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:36.992068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.992984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.993165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.993260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.993436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.993518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:36.993707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.012650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.012790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.012933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.013145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.017417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.017678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.021081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.021285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.021370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.021585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.026391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.026682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.030655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.031010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.034194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.034491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.034799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.034995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.035079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.035355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.035500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.035626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.035931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.036225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.036506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.036808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.056342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.056621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.056893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.057153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.059169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.059596 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.059875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.060141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.064987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.066799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.067070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.067892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.069562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.069839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.070035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.070312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.070607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.070894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.071163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.072971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.073251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.073529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.073827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.074104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.085952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.086225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.086504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.086809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.087090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.087361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.087640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.087729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.087995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.088274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.088551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.088834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.091172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.091471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.105876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.109592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.109735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.112825 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.113112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.114694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.116098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.116275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.116548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.116834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.117813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.119450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.119729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.120027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.124243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.125808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.127209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.128777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.129142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.129428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.129706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.129986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.131970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.132261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.132653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.132942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.138963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.139246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.139534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.142097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.142383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.142704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.147393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73793) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.147621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.147898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.148169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.148442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.148717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.148990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.149253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.149516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.149777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.150049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.150325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.150431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:43:37.150611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.150740 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.150875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73793) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.151022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.151305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.151583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.151953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.152234 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.152505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.152773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.153796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.154084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.154361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.154662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.154931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:43:37.189253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e72377e9c0 pid: 73793 (default app) Aug 27 03:43:37.192569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bd2e-9f7e-4818-b195-a7208a9f7783 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:37.192862 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bd2e-9f7e-4818-b195-a7208a9f7783 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:37.193135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bd2e-9f7e-4818-b195-a7208a9f7783 None None] PATH_INFO: `/v3` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:37.193234 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e72377e9c0 pid: 73792 (default app) Aug 27 03:43:37.197272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 792 bytes} [Fri Aug 27 03:43:37 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:45.952766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6b57-1d12-4c81-b7d3-f16a79173d24 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:45.953298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6b57-1d12-4c81-b7d3-f16a79173d24 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:45.953298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6b57-1d12-4c81-b7d3-f16a79173d24 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:45.958294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:45 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:43:45.964173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:45.964586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:45.964730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:45.998239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG oslo_db.sqlalchemy.engines [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:43:46.187105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG passlib.handlers.bcrypt [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73793) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 03:43:46.187516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG passlib.handlers.bcrypt [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73793) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 03:43:46.243775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:46.245307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:46.394064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:46.554310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6b57-1d12-4c81-b7d3-f16a79173d24 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:46.588107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG oslo_db.sqlalchemy.engines [None req-c08d6b57-1d12-4c81-b7d3-f16a79173d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:43:46.718634 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6b57-1d12-4c81-b7d3-f16a79173d24 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:46.722885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:46.723544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:46.723823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:46.724096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:46.732832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:46.783813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.common.rbac_enforcer.enforcer [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 03:43:46.784151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecd7a9-94c6-4c4e-8562-4d7707301731 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:46.794823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:43:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:43:46.801423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:46.815615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f823d4d-d118-4530-bf0c-bb0f4f417964 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:46.820010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:46.821106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:46.821387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:46.821656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] PATH_INFO: `/v3/projects/d619747d92dd4ce8a23a9280f1833108` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:46.823240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d619747d92dd4ce8a23a9280f1833108)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:46.876333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 03:43:46.876668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8069d86-344b-4a50-bf9a-9241475868b2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:46.881435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:43:46 2021] GET /identity/v3/projects/d619747d92dd4ce8a23a9280f1833108 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:49.102202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53550cf7-cd26-45ea-8ba9-e380b6edaf10 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:49.102836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53550cf7-cd26-45ea-8ba9-e380b6edaf10 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:49.103142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53550cf7-cd26-45ea-8ba9-e380b6edaf10 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:49.108974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:49 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:49.115208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:49.115647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:49.115776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:49.134755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:49.136288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:49.144793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:49.168278 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53550cf7-cd26-45ea-8ba9-e380b6edaf10 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:49.180748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53550cf7-cd26-45ea-8ba9-e380b6edaf10 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:49.186127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e534-9bec-4483-80c0-f0758f3f2104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:49.186796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e534-9bec-4483-80c0-f0758f3f2104 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:49.187084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e534-9bec-4483-80c0-f0758f3f2104 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:49.187364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e534-9bec-4483-80c0-f0758f3f2104 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:49.194931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e534-9bec-4483-80c0-f0758f3f2104 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:49.196704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e534-9bec-4483-80c0-f0758f3f2104 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:49.206245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:43:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:49.212341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:49.221249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4be92-74a3-47d3-8960-308ba36be684 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:49.225730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c2c3-2fea-4a09-933b-433386ec5969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:49.226537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c2c3-2fea-4a09-933b-433386ec5969 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:49.226849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c2c3-2fea-4a09-933b-433386ec5969 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:49.227129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c2c3-2fea-4a09-933b-433386ec5969 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:49.228510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c2c3-2fea-4a09-933b-433386ec5969 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:49.230353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c2c3-2fea-4a09-933b-433386ec5969 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:49.232111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:43:49 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:51.417133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea0c20-82c6-49b4-bf58-cd6c537a19ab None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.417712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea0c20-82c6-49b4-bf58-cd6c537a19ab None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.417712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea0c20-82c6-49b4-bf58-cd6c537a19ab None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.419542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:43:51.426097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.426602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.426722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.444823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:51.446015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:51.454308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 6/11] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:51.472127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995ccc-cbea-4cfc-a728-b6a36658d0c1 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.472490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995ccc-cbea-4cfc-a728-b6a36658d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.472836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995ccc-cbea-4cfc-a728-b6a36658d0c1 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.474669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 6/12] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:51.477822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.480444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.480906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.481318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.487160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9a8a-aff8-4102-a912-08b50cb1cbc6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.491494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.492277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.492561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.492835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.506192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:43:51.513722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:43:51.514951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 7/13] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:43:51.521211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.524346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG passlib.handlers.bcrypt [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73792) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 03:43:51.524777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG passlib.handlers.bcrypt [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73792) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 03:43:51.530627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fea0ef-c488-43ea-b203-e8a4911881f2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.534953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.535590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.535872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.536147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.536887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:51.537188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:51.538948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:51.538948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:43:51.538948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:43:51.539872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:51.552649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 8/14] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:51.559509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.568464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0079-ff09-49e3-bd36-5484a843c47f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.571680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:51.572765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.573434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:51.573581 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.573863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.574856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.576197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:51.578000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:51.579566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 9/15] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:51.585452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.594799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a9bc0-0596-4618-8d03-04fe7f562eb9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.599071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.599815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.600091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.600367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.601500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:51.603190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:51.604695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 10/16] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:51.611257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.611863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 7/17] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:51.620526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1700a7-96f4-45c6-bf2a-f9f513788d6f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.625569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.626263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.626644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.626988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.627898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.domain.id=default, user.id=d7499c7d953346c79b8adf6b0557fa02) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:51.628268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:51.629249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:51.629249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:43:51.629249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:43:51.630418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:51.635446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.637496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 11/18] 10.222.0.73 () {56 vars in 1344 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/role_assignments?user.id=d7499c7d953346c79b8adf6b0557fa02&scope.domain.id=default&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:51.644788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e14a9-cbdd-4d0b-963d-31ba8da8b490 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.649373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23cdbd-7027-4ff6-b258-2cb5428ca59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.650371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23cdbd-7027-4ff6-b258-2cb5428ca59a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.650680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23cdbd-7027-4ff6-b258-2cb5428ca59a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.650956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23cdbd-7027-4ff6-b258-2cb5428ca59a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.659958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23cdbd-7027-4ff6-b258-2cb5428ca59a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:51.661854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23cdbd-7027-4ff6-b258-2cb5428ca59a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:51.673166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 8/19] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:43:51.679301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:51.690230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4c27-ae7f-4427-b358-8ff4036ff9d8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:51.695106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ec72-ae1d-420a-9337-fe1967c8203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:51.696031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ec72-ae1d-420a-9337-fe1967c8203a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:51.696323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ec72-ae1d-420a-9337-fe1967c8203a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:51.696599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ec72-ae1d-420a-9337-fe1967c8203a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:51.697900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ec72-ae1d-420a-9337-fe1967c8203a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:51.700269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ec72-ae1d-420a-9337-fe1967c8203a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:51.702118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 12/20] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:54.766206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b4ef-45b6-40c4-a44a-995c078bd085 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:54.766839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b4ef-45b6-40c4-a44a-995c078bd085 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:54.767258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b4ef-45b6-40c4-a44a-995c078bd085 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:54.770939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 9/21] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:54 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:54.781247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691cf45-0028-48cf-bb46-fa2301bdc584 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:54.781813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691cf45-0028-48cf-bb46-fa2301bdc584 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:54.782244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691cf45-0028-48cf-bb46-fa2301bdc584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:54.821384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3691cf45-0028-48cf-bb46-fa2301bdc584 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:54.823412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3691cf45-0028-48cf-bb46-fa2301bdc584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:54.842468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 13/22] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:54.912069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767b4ef-45b6-40c4-a44a-995c078bd085 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:54.941097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767b4ef-45b6-40c4-a44a-995c078bd085 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:54.952172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc00d-b5d7-44d7-9718-6ed6af091217 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:54.953043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc00d-b5d7-44d7-9718-6ed6af091217 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:54.953620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:54.953886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc00d-b5d7-44d7-9718-6ed6af091217 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:54.954742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:54.955427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:54.955893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:54.957202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:54.959024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 14/23] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:54 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:54.962594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:54.962594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:43:54.962594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:43:54.962594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca340-b3d8-4763-a8a5-1f92ab91ef0b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:54.966466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:54.967372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:54.968160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.017215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:55.022259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:55.036503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 15/24] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:55.062806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.079898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a6918-5643-4c61-806a-0735c0f510cf None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.088312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.090633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.092614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.092614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.112027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.116181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.156197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:43:55.158780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 16/25] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:43:55.165939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.184247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f6f70-9197-42e6-a0c1-070ea430149b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.192302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.193695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.194407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.195171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.196824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:55.197659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.199841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:55.199841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:43:55.199841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:43:55.202151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.235410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 17/26] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:43:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:55.242704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.264885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144f31-5696-4f3d-8aba-8685cbe1e7be admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.278600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.280305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.281095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.281873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.283414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.285499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:55.285499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:43:55.285499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:43:55.294446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.366235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 10/27] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:54 2021] POST /identity/v3/roles => generated 219 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:55.367615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec43ea-0f50-4e63-82c9-14b9eb021af8 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.367995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec43ea-0f50-4e63-82c9-14b9eb021af8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.368343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec43ea-0f50-4e63-82c9-14b9eb021af8 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.370262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 11/28] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:55.376757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.377064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.377322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.411840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:55.413435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:55.429282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 12/29] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:55.470139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.483887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980370-793f-49ee-ac12-ae5ef210186a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.495414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.497165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.497590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.498003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.517200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:43:55.532857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:43:55.534348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 13/30] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:43:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:43:55.541209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.566315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f52f0-d834-463c-9235-654883397735 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.584367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.585319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.585744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.586167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.587112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:55.587555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.588909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:55.588909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:43:55.588909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:43:55.590110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.617443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 14/31] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:43:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:55.624191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.640928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad45189-8b88-425f-837c-a9d413904bd2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.660370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.661500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.661923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.662334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.668528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.670664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.672497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 15/32] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:43:55 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:55.678824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.690277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f75b65-a902-48b8-b86a-fbe361119f1c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.697757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.698810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.699789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.700221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.701723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.703806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.705970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 16/33] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:55.712425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:55.726157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0c61c-3ab1-4369-8e72-2d37ba1a2168 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:55.733695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:55.735048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.735583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.736081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] PATH_INFO: `/v3/domains/default/users/d7499c7d953346c79b8adf6b0557fa02/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.738777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d7499c7d953346c79b8adf6b0557fa02, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:55.740136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:55.740136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:43:55.740136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:43:55.742716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f92aa-0fae-4a3a-92b4-0bb95a33bec3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:55.858937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 17/34] 10.222.0.73 () {58 vars in 1383 bytes} [Fri Aug 27 03:43:55 2021] PUT /identity/v3/domains/default/users/d7499c7d953346c79b8adf6b0557fa02/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:55.861291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76d26-3f19-41ec-960f-56d859b6ad34 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.861804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76d26-3f19-41ec-960f-56d859b6ad34 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.862297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76d26-3f19-41ec-960f-56d859b6ad34 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.864706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 18/35] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:55.870745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26446-4b58-431d-b59a-6b777e97a5ac None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:55.873767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26446-4b58-431d-b59a-6b777e97a5ac None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:55.876492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26446-4b58-431d-b59a-6b777e97a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:55.881448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 18/36] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:43:55 2021] POST /identity/v3/projects => generated 301 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:55.901269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b0e26446-4b58-431d-b59a-6b777e97a5ac None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:55.903199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b0e26446-4b58-431d-b59a-6b777e97a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:55.996614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 19/37] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:56.032781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:56.048110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54f661-81d4-4bd1-b349-8bacb8adf296 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:56.053590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:56.054387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.054709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.055047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.055820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:56.057100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:56.057100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:43:56.057100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:43:56.058074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9f91-59a5-40af-bf32-9140905ad089 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:56.172382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 19/38] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:56 2021] POST /identity/v3/roles => generated 225 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:56.716443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d8e0-6bae-4583-9f04-3b14f0ea3749 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.716960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d8e0-6bae-4583-9f04-3b14f0ea3749 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.717466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d8e0-6bae-4583-9f04-3b14f0ea3749 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.721356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 20/39] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:56 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:56.732937 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c870-3b5b-46b1-853a-405bab496966 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.733442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c870-3b5b-46b1-853a-405bab496966 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.733940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c870-3b5b-46b1-853a-405bab496966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.766543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-81f1c870-3b5b-46b1-853a-405bab496966 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:56.769245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-81f1c870-3b5b-46b1-853a-405bab496966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:56.782854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 20/40] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:56.797247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1a55-e18a-441b-bf67-60a9eaf60d94 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.797540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1a55-e18a-441b-bf67-60a9eaf60d94 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.797820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1a55-e18a-441b-bf67-60a9eaf60d94 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.799609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 21/41] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:56.805584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.805878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.806157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.822990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1a55-e18a-441b-bf67-60a9eaf60d94 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:56.824791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:56.825904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:56.833650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 21/42] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:56.841447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1a55-e18a-441b-bf67-60a9eaf60d94 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:56.846257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba1fc0-c357-4d86-8e3f-1a74ce840628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:56.846953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1fc0-c357-4d86-8e3f-1a74ce840628 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.847250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1fc0-c357-4d86-8e3f-1a74ce840628 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.847517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba1fc0-c357-4d86-8e3f-1a74ce840628 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.848280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba1fc0-c357-4d86-8e3f-1a74ce840628 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:56.849909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba1fc0-c357-4d86-8e3f-1a74ce840628 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:56.858290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:56.867151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fac70-4777-4f80-8ebc-103621fd5a5d None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:56.878886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:56.878886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.878886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.878886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.879279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:56.879279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:56.879279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 22/43] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:56.883492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:56.893233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ea1a0-5dc8-4a5b-99f1-45ec7279c4b5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:56.897589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c089cd-3c41-4f5e-ae60-6a8a3498559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:56.898186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c089cd-3c41-4f5e-ae60-6a8a3498559f admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:56.901823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c089cd-3c41-4f5e-ae60-6a8a3498559f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:56.901823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c089cd-3c41-4f5e-ae60-6a8a3498559f admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:56.901823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c089cd-3c41-4f5e-ae60-6a8a3498559f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:56.901823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c089cd-3c41-4f5e-ae60-6a8a3498559f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:56.921488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:56 2021] POST /identity/v3/roles => generated 223 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:56.992800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 23/45] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:43:56 2021] POST /identity/v3/projects => generated 312 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:58.482708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d19b5-9980-4e97-8d50-401a96f620e0 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.483255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d19b5-9980-4e97-8d50-401a96f620e0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.483255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d19b5-9980-4e97-8d50-401a96f620e0 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.485059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 23/46] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:58.491079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.491487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.491773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.510053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:58.511317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:58.568239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 24/47] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:58.592844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d19b5-9980-4e97-8d50-401a96f620e0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.604950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d19b5-9980-4e97-8d50-401a96f620e0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.609834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.610652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.610938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.611214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.622405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:43:58.629150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:43:58.630336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 24/48] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:43:58.637252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.646061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d472bc-8d9b-4b1a-bff7-ae5a1b0f2a4a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.650462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.651150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.651436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.651712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.652580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:58.652881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.654488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.662935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 25/49] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:58.669642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.679771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99267-39b9-44e3-99eb-fa5ec2bf14e2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.685016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.685880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.686166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.686445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.687711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.689543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.691162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 25/50] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:58.697142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.707301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5b0e-686c-497d-8793-62ce8bed6ad4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.711614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa75ba-ad1b-4bce-8601-35cdcbcf4724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.712402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa75ba-ad1b-4bce-8601-35cdcbcf4724 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.712686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa75ba-ad1b-4bce-8601-35cdcbcf4724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.712965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa75ba-ad1b-4bce-8601-35cdcbcf4724 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.714123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa75ba-ad1b-4bce-8601-35cdcbcf4724 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.716729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa75ba-ad1b-4bce-8601-35cdcbcf4724 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.718507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 26/51] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:58.724500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.735008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12f79-d8d5-4d4e-80c2-35c3faec06d3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.739478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.740132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.740418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.740697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.741525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.domain.id=default, user.id=d7499c7d953346c79b8adf6b0557fa02) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:58.741836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.743058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:58.743058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:43:58.743058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:43:58.744032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40684af6-4d0e-41bc-9a6e-610ce83c8700 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.752565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 26/52] 10.222.0.73 () {56 vars in 1344 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/role_assignments?user.id=d7499c7d953346c79b8adf6b0557fa02&scope.domain.id=default&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 530 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:59.175354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3614-7c32-4f80-b722-e0e636e7188b None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:59.175647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3614-7c32-4f80-b722-e0e636e7188b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:59.175928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3614-7c32-4f80-b722-e0e636e7188b None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:59.177717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 27/53] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:43:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:43:59.183806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:59.184100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:59.184385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:59.202357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:59.203612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:59.211162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 27/54] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:43:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:59.235473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f3614-7c32-4f80-b722-e0e636e7188b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:59.247514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f3614-7c32-4f80-b722-e0e636e7188b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:59.251736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c2001-1101-4f7a-b060-412cdf164502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:59.252512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2001-1101-4f7a-b060-412cdf164502 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:59.252795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2001-1101-4f7a-b060-412cdf164502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:59.253068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2001-1101-4f7a-b060-412cdf164502 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:59.254216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c2001-1101-4f7a-b060-412cdf164502 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:59.256068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c2001-1101-4f7a-b060-412cdf164502 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:59.257626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 28/55] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:43:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:59.264185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:59.273499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f767d5-0a67-4d18-bcb0-31db2a2d10cd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:59.278643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:59.279293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:59.279579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:59.279856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:59.280563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:59.281570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:43:59.281570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:43:59.281570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:43:59.282819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c24e1-679b-4837-9f71-5e1a15ab4d05 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:59.380761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 28/56] 10.222.0.73 () {60 vars in 1162 bytes} [Fri Aug 27 03:43:59 2021] POST /identity/v3/projects => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:01.522768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a372e-8725-44db-bf2d-a0ef146fb239 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:01.523301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a372e-8725-44db-bf2d-a0ef146fb239 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:01.523301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a372e-8725-44db-bf2d-a0ef146fb239 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:01.525097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 29/57] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:01.531792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:01.532185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:01.532352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:01.550688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:01.551877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:01.607082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 29/58] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:01.632032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a372e-8725-44db-bf2d-a0ef146fb239 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:01.643791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a372e-8725-44db-bf2d-a0ef146fb239 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:01.647961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898e0af-23e9-4076-8ed5-b0ee2a0cb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:01.648739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898e0af-23e9-4076-8ed5-b0ee2a0cb7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:01.649025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898e0af-23e9-4076-8ed5-b0ee2a0cb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:01.649330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898e0af-23e9-4076-8ed5-b0ee2a0cb7d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:01.650481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898e0af-23e9-4076-8ed5-b0ee2a0cb7d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:01.652191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898e0af-23e9-4076-8ed5-b0ee2a0cb7d9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:01.653729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 30/59] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:01.659642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:01.669642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775b7be-9b67-4e77-9047-450b9deb2430 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:01.674081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:01.674942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:01.675229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:01.675568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:01.676226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:01.677233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:01.677233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:01.677233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:01.678482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c20dc5-058f-4c66-ba09-83debb8a22b9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:01.780527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 30/60] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:01 2021] POST /identity/v3/users => generated 275 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:05.275588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f53490-96bb-412b-b221-a91a6a91ce4c None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.276072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f53490-96bb-412b-b221-a91a6a91ce4c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.276325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f53490-96bb-412b-b221-a91a6a91ce4c None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.279838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 31/61] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:05.290315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.290916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.291398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.334106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:05.336274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:05.343181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0339-d03f-4731-8866-14845de26243 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.343496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0339-d03f-4731-8866-14845de26243 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.343889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0339-d03f-4731-8866-14845de26243 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.345822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 32/62] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:05.355793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 31/63] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:05.363518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.364101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.364604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.406933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:05.407446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.408969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:05.427832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 33/64] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:05.428379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3f33-f086-4e25-8bef-ff6f4edb343c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.441428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.443193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.443998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.444774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.474489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:05.493804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:05.497056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 32/65] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:05.506183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.522150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.538362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c67652-9bb7-4a0b-952c-7b5f18457bbf None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.552646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5fb1-4e42-4bff-bd19-e8d88a540976 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.556166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.557659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.558485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.559335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.561006 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:05.563001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.566237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.581674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.583670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.584460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.585224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.600633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 34/66] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.608145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.622258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:05.638283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:05.639903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 33/67] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:05.650439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810e4e4-e225-4b34-8b50-210383108425 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.651859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.664490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a6c7b-84f4-4095-87f9-14e49b1d23f7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.667722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.668885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.669367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.669838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.682019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.683664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.684188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.684756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.685776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:05.686977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.688924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.702504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.705122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.707198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 35/68] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.709536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.718167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.723657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.737034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466ddd-466f-42f9-ba76-6e713dd822f9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.739452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca750-83f1-4883-a3ed-eb8a54d77aca admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.748482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc982-d127-4d62-9e02-4c29ce2b4eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.749421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc982-d127-4d62-9e02-4c29ce2b4eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.750168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.750700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc982-d127-4d62-9e02-4c29ce2b4eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.751199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc982-d127-4d62-9e02-4c29ce2b4eb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.752274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.753327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.754157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.759758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.762698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.764609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 36/70] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:05.767735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc982-d127-4d62-9e02-4c29ce2b4eb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.769540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc982-d127-4d62-9e02-4c29ce2b4eb5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.774583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.781151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 35/71] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:05.782546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167688-535d-4cc1-9173-093b2e110a36 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.782864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167688-535d-4cc1-9173-093b2e110a36 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.783146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167688-535d-4cc1-9173-093b2e110a36 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.789393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 36/72] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:05.791494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.792296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.792793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.795731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5dc98-fe56-4096-b22f-142a45952da0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.802262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.803540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.804143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.804753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.811955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:05.813171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:05.818636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.821345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 37/73] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:05.821766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.827446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.836818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 37/74] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:05.845111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bd6b-01de-4120-8b51-2e67b941b8cf None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.845671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.854385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.855835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.856161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b3e3-6b10-4bd1-bfdb-152170ae03f1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.856327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.856682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.857998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.860738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.861602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.862673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.863101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.863540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.869409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 38/75] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.870617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.870762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.873086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.875549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 38/76] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.879628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.882195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d0e4-539c-4366-94fe-3a704364325e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.887720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.888490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.888848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.889200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.890139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] RBAC: Adding query filter params (role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0, user.id=ce757ce3882c4a3787f07fc82ba39a09) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:05.890518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.893137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.897523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d06e-eeb1-4e0c-ad57-99b4ce41420b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.899784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 39/77] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/role_assignments?user.id=ce757ce3882c4a3787f07fc82ba39a09&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=322777f2a56841baaad99b09485c4a0e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.901017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.912829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc102-c330-4cfa-a6ea-00cefc360f8a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:05.915983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0022be-a3ed-4821-8a32-521b1c1959de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.918055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0022be-a3ed-4821-8a32-521b1c1959de admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.918499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0022be-a3ed-4821-8a32-521b1c1959de admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.918992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0022be-a3ed-4821-8a32-521b1c1959de admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.920140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:05.921043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:05.921510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:05.921958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:05.923174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0, user.id=d7499c7d953346c79b8adf6b0557fa02) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:05.923880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:05.926041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:05.932428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 40/78] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/role_assignments?user.id=d7499c7d953346c79b8adf6b0557fa02&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:05.944901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0022be-a3ed-4821-8a32-521b1c1959de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:05.957415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-0f0022be-a3ed-4821-8a32-521b1c1959de admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:05.958824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 39/79] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:05.966802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:05.992330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaacbb-e21a-4ede-bac6-5b9154331ede admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.003924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90e914-8d37-496b-9410-17ab88987c8d None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.004713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90e914-8d37-496b-9410-17ab88987c8d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.005382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90e914-8d37-496b-9410-17ab88987c8d None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.008617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 40/80] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:06.010606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.011472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.011759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.012040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.012869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:06.013184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.018628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.028563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6bec-b88b-4483-9931-8246153c529d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.034586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6bec-b88b-4483-9931-8246153c529d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.034586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6bec-b88b-4483-9931-8246153c529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.036956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 41/81] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:06.044430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.054322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c3ca6bec-b88b-4483-9931-8246153c529d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:06.054322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c3ca6bec-b88b-4483-9931-8246153c529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:06.060899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dfc34-103e-428f-8765-7238372fc3b1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.064098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 41/82] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:06.066060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5492-fd95-415b-bcb5-d7461d150366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.066988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5492-fd95-415b-bcb5-d7461d150366 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.067377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5492-fd95-415b-bcb5-d7461d150366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.067619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a3677-2223-4c7f-9ca0-8c4e474f0cb3 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.067733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5492-fd95-415b-bcb5-d7461d150366 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.068485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a3677-2223-4c7f-9ca0-8c4e474f0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.068900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5492-fd95-415b-bcb5-d7461d150366 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.069228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a3677-2223-4c7f-9ca0-8c4e474f0cb3 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.071141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5492-fd95-415b-bcb5-d7461d150366 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.072819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 42/83] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:06.073915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 42/84] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:06 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:06.080583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.081215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.081694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.084698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a3677-2223-4c7f-9ca0-8c4e474f0cb3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.103321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:06.105096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:06.109625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a3677-2223-4c7f-9ca0-8c4e474f0cb3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.114223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 43/85] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:06.115500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.118600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.119788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.121108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.121561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.126916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd03a-9b6d-4e52-a67a-d98a93b5ab33 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.132568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.133715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.134858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.135343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.139357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.142947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.149478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:06.157029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 43/86] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:06.159359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:06.160900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 44/87] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:06.163855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.171740 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.179536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094096-7e79-4704-86c0-b906d3b58b50 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.185883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.186627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829e6c9-bdec-479a-bf7d-b7dc9712cec6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.187440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.187922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.188439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.190034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.192511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.193297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.194294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.194748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.195161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.195692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 44/88] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:06.196726 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:06.196975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.197205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.200501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.214761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475769-d12a-4218-858f-a5e324b072ea admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.215589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 45/89] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:06.216710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.220386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.221423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.221909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.222403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.224071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.225994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.227468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8027-520c-46fd-a755-e7ee16328496 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.228149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 45/90] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:06.229116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.232707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.233385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.234002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.234382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.235388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] RBAC: Adding query filter params (role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0, user.id=ce757ce3882c4a3787f07fc82ba39a09) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:06.235615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.237660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.240974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf37b-7c0b-4366-b179-ac72a65d71fe admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.244964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 46/91] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/role_assignments?user.id=ce757ce3882c4a3787f07fc82ba39a09&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:06.247442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.251438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.253140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.253935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.255247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.257277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.263597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.269826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 46/92] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:06.271365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d1b4-be77-48c7-b26c-3db1875a2aa5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.275101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.287647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3006e9d-1e47-401b-8baa-5e54fb31fcf3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.288300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b30af-5ff3-4b90-b137-0979aa9bd205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.288736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b30af-5ff3-4b90-b137-0979aa9bd205 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.289019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b30af-5ff3-4b90-b137-0979aa9bd205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.289296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b30af-5ff3-4b90-b137-0979aa9bd205 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.290022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b30af-5ff3-4b90-b137-0979aa9bd205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.293171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b30af-5ff3-4b90-b137-0979aa9bd205 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.295979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.296920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.297424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.297845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.307490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.310374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.321259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 47/93] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:06.331657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.341459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b9c88-2464-4331-9f3d-8725d129f5ad admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.346670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.347763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.348193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.353415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] PATH_INFO: `/v3/projects/83d9ff3d963340b99d57cbb22d01eef9` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.353415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] RBAC: Authorizing `identity:get_project(project_id=83d9ff3d963340b99d57cbb22d01eef9)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.353415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.353941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 48/94] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/projects/83d9ff3d963340b99d57cbb22d01eef9 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:06.363286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:06.374756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e2aff-9c78-4fce-a663-415e98776e99 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:06.379479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:06.380150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:06.380438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:06.380720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:06.386584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] RBAC: Adding query filter params (role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=83d9ff3d963340b99d57cbb22d01eef9, user.id=ce757ce3882c4a3787f07fc82ba39a09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:06.386584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:06.386584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed455aa-8ac5-4f08-a761-6c52400978aa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:06.390608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 49/95] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:06 2021] GET /identity/v3/role_assignments?user.id=ce757ce3882c4a3787f07fc82ba39a09&scope.project.id=83d9ff3d963340b99d57cbb22d01eef9&role.id=322777f2a56841baaad99b09485c4a0e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:06.421654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 47/96] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:44:06 2021] POST /identity/v3/projects => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:08.548700 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f716a7-9147-4a52-947e-6716517d0336 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.549214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f716a7-9147-4a52-947e-6716517d0336 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.549286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f716a7-9147-4a52-947e-6716517d0336 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.551254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 50/97] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:08.569052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.569991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.570473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.599637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:08.601229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:08.677505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 48/98] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:08.714380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f716a7-9147-4a52-947e-6716517d0336 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:08.736289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f716a7-9147-4a52-947e-6716517d0336 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:08.746903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:08.747722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.748005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.748284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.770580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:08.778319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:08.784936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 51/99] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:08.786132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:08.805528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ecb-c1da-4bed-a4c9-a5cfa1fbdb14 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:08.820383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:08.821457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.822120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.822636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.823883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:08.824496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:08.826358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:08.835950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 49/100] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:08.842664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:08.857595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd556d-f5f7-4851-9d67-1aed4dd82252 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:08.875255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:08.876163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.876453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.876734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.878033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:08.880232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:08.881857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 52/101] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:08 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:08.888583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:08.898857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d4ab6-92df-4249-9e62-f9be7883e1c5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:08.910882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62ba57-924f-4d51-bd1a-d91d5b4f6387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:08.912039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62ba57-924f-4d51-bd1a-d91d5b4f6387 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.912528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62ba57-924f-4d51-bd1a-d91d5b4f6387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.913031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62ba57-924f-4d51-bd1a-d91d5b4f6387 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.915653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62ba57-924f-4d51-bd1a-d91d5b4f6387 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:08.919153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62ba57-924f-4d51-bd1a-d91d5b4f6387 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:08.922177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 50/102] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:08 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:08.928050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:08.938383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287a37-d570-4518-9be0-62b228a84d71 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:08.955908 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:08.956826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:08.957115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:08.957397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/users/ce757ce3882c4a3787f07fc82ba39a09/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:08.963394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3953d9945a8c4f53a64136a4286b7dd0, user_id=ce757ce3882c4a3787f07fc82ba39a09, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:08.964499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:08.964499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:08.964499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:08.966767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858e0cc-f0c6-4d74-be89-92c975ca5aea admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.066702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 53/103] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:08 2021] PUT /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/users/ce757ce3882c4a3787f07fc82ba39a09/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:09.129771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8853-1b00-45c1-b113-9f0aa1ce72ed None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.130189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8853-1b00-45c1-b113-9f0aa1ce72ed None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.130603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8853-1b00-45c1-b113-9f0aa1ce72ed None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.133332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 51/104] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:09.141090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466e60-c46d-4048-a442-500fcefb2da3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.141424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466e60-c46d-4048-a442-500fcefb2da3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.141714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466e60-c46d-4048-a442-500fcefb2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.162342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-77466e60-c46d-4048-a442-500fcefb2da3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:09.163738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-77466e60-c46d-4048-a442-500fcefb2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:09.255848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 54/105] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:09.295299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e8853-1b00-45c1-b113-9f0aa1ce72ed None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.311631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242f5e-5ab3-4afd-ae21-0377077731bd None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.311929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242f5e-5ab3-4afd-ae21-0377077731bd None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.312217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242f5e-5ab3-4afd-ae21-0377077731bd None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.314144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 55/106] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:09.315584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e8853-1b00-45c1-b113-9f0aa1ce72ed None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.321622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c3eb8-cafb-458a-b829-5dfd256a1558 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.321899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c3eb8-cafb-458a-b829-5dfd256a1558 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.322099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c3eb8-cafb-458a-b829-5dfd256a1558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.322337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.323494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.324039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.324516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.341502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:09.349581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:09.351180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 52/107] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:09.356667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a04c3eb8-cafb-458a-b829-5dfd256a1558 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:09.358303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a04c3eb8-cafb-458a-b829-5dfd256a1558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:09.362066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.370647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 56/108] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:09.374236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ede285-48fe-4c4d-95a7-7059c75b6aa1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.379418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.380505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.380987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.381474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.382476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:09.383019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.384874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0f0bc-a946-4e9f-92c8-d00370746c24 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.394636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 53/109] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:09.396371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d8e4-80d5-427f-812b-637acfbbefd7 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.396671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d8e4-80d5-427f-812b-637acfbbefd7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.396958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d8e4-80d5-427f-812b-637acfbbefd7 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.398806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 57/110] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:09.406264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d8e4-80d5-427f-812b-637acfbbefd7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.406457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.406457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.406772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.424447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d8e4-80d5-427f-812b-637acfbbefd7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.429791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.429993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:09.431160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.431700 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.431801 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:09.432350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.445671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 54/111] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:09.445846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:09.453901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.459328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889a702-d83f-48e5-8b4c-ac635114e82d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.461509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:09.462989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 58/112] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:09.466708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.467778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.468131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.468535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.470207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.471368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.472417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.474544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 55/113] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.481300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.482997 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a8c2-b865-4979-9e07-72e54a671a5d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.500252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7881df9-ea75-40d1-a38f-6f0cae8bc561 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.502142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.503151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.503686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.504187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.505516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:09.506058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.507809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.508220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.509414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.509950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.510550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] PATH_INFO: `/v3/projects/83d9ff3d963340b99d57cbb22d01eef9` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.513956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] RBAC: Authorizing `identity:get_project(project_id=83d9ff3d963340b99d57cbb22d01eef9)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.518256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.520599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 59/114] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.525789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 56/115] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/projects/83d9ff3d963340b99d57cbb22d01eef9 => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.525789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.527531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.537120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22767c-767a-4b65-a125-24b6c0385ef8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.542777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b40bc-5f54-43db-95b4-98be42f7791e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.543975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.545024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.545435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.545777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.549297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.550782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.551559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.552133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.553802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.556802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.557258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:09.559717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 60/116] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.565601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.567030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:09.568492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 57/117] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:09.569352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.584577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8c60b-aaf6-4714-a058-7267e9f0f24a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.587479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b359509-5375-44b4-a4c3-acb03595fa4a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.594991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.595389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.596256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.596600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.596890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.597392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.597878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.598271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.598599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] PATH_INFO: `/v3/projects/83d9ff3d963340b99d57cbb22d01eef9/users/ce757ce3882c4a3787f07fc82ba39a09/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.600582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.601246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d9ff3d963340b99d57cbb22d01eef9, user_id=ce757ce3882c4a3787f07fc82ba39a09, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.608475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 58/118] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.608475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.611740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.616631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685321c9-5a47-4182-b49e-8ed09ea25f70 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.625830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.627033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.627476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.634392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.634392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:09.634392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.634392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.647580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 59/119] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.647580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.658748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0201-7f0b-4eef-bf74-0d30719ade77 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.663223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81bc35-2c72-4a5a-afcd-1a0eac7f2c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.664875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bc35-2c72-4a5a-afcd-1a0eac7f2c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.664875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bc35-2c72-4a5a-afcd-1a0eac7f2c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.664875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bc35-2c72-4a5a-afcd-1a0eac7f2c81 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/users/d7499c7d953346c79b8adf6b0557fa02/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.667002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81bc35-2c72-4a5a-afcd-1a0eac7f2c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3953d9945a8c4f53a64136a4286b7dd0, user_id=d7499c7d953346c79b8adf6b0557fa02, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.669704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81bc35-2c72-4a5a-afcd-1a0eac7f2c81 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.701574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 61/120] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:09 2021] PUT /identity/v3/projects/83d9ff3d963340b99d57cbb22d01eef9/users/ce757ce3882c4a3787f07fc82ba39a09/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:09.710732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.755003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 60/121] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:09 2021] PUT /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/users/d7499c7d953346c79b8adf6b0557fa02/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:09.758337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f111-3a78-452b-97e4-c1ab898c1e34 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.759035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f111-3a78-452b-97e4-c1ab898c1e34 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.759654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f111-3a78-452b-97e4-c1ab898c1e34 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.763338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 61/122] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:09 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:09.777099 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.778208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.778738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.806035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd767a1-42ed-43c2-bf1c-8cb2d6722b51 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.818185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:09.821455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:09.925494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.926824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.927390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.927867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.929384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.931884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.934082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 62/123] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:09.940419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:09.952569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0620f-2c7e-4995-b35b-4dd9e86aeb6f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:09.958047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 62/124] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:09.959485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:09.960857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:09.961341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:09.961881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:09.963517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:09.966981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:09.969059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 63/125] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:09 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:09.976938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:10.001378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfce0a-3063-478f-b218-802959323f2d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:10.006418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda947-77a7-4d21-b228-a15f4578111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:10.007413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda947-77a7-4d21-b228-a15f4578111a admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:10.007726 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda947-77a7-4d21-b228-a15f4578111a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:10.008009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda947-77a7-4d21-b228-a15f4578111a admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/users/ce757ce3882c4a3787f07fc82ba39a09/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:10.010316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dda947-77a7-4d21-b228-a15f4578111a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3953d9945a8c4f53a64136a4286b7dd0, user_id=ce757ce3882c4a3787f07fc82ba39a09, role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:10.013286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dda947-77a7-4d21-b228-a15f4578111a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:10.023814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:10.038051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f676f80-5306-4e3e-9209-341376318559 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:10.048803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:10.050393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:10.053112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:10.053112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:10.053457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:10.056718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:10.060569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 64/126] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:10.066615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:10.077571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65963-1193-404a-a24d-2e0e7918c345 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:10.082690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:10.083428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:10.083768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:10.084045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:10.084824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:10.085993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:10.085993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:10.085993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:10.095399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 63/127] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:09 2021] PUT /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/users/ce757ce3882c4a3787f07fc82ba39a09/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:10.095571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba36c-19bd-4bdd-9145-8997862f1c94 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:10.175821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 65/128] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:10 2021] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:44:11.699079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6802-8e58-43e1-8f6b-38ca10535941 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:11.699783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6802-8e58-43e1-8f6b-38ca10535941 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:11.700170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6802-8e58-43e1-8f6b-38ca10535941 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:11.702486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 64/129] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:11.711307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:11.711793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:11.711919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:11.734421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:11.735685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:11.805075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 66/130] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:11.837773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6802-8e58-43e1-8f6b-38ca10535941 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:11.864805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6802-8e58-43e1-8f6b-38ca10535941 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:11.873691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:11.874768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:11.875397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:11.875945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:11.899529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:11.907869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:11.909362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 65/131] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:11.916077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:11.932100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f26ac-737e-42e7-9255-5c6ffdd6a343 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:11.941240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:11.941941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:11.942227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:11.942506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:11.943323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:11.943632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:11.945286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:11.958629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 67/132] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:11.965921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:11.988621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538688ef-ee26-4661-8add-85bb5423e4ae admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.002330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.003531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.003985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.004429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.008462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.011013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.013265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 66/133] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:11 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.019894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.035887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690cf55-061d-423f-bd80-e9817611f197 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.040442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.041111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.041401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.042526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.061683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.063533 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.080990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 68/134] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:12.087547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.103826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd44b-fafc-4c72-8d10-4f0bd5604766 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.115003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472da49-7a85-4dca-b872-b956d5bdd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.116239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472da49-7a85-4dca-b872-b956d5bdd6ba admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.116716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472da49-7a85-4dca-b872-b956d5bdd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.117184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472da49-7a85-4dca-b872-b956d5bdd6ba admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.123417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472da49-7a85-4dca-b872-b956d5bdd6ba admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.125794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472da49-7a85-4dca-b872-b956d5bdd6ba admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.127906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 67/135] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.134698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.147761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc74b4-2ee2-4f74-86f6-c48a5a7a098a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.153105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.153791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.154081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.154365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.155255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] RBAC: Adding query filter params (role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0, user.id=ce757ce3882c4a3787f07fc82ba39a09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:12.155572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.157473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4d74c-ebce-4b14-8beb-ba046df9a8f7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.173285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 69/136] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/role_assignments?user.id=ce757ce3882c4a3787f07fc82ba39a09&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=322777f2a56841baaad99b09485c4a0e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.568770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c6c7-27c6-48f7-bcc4-01d9643b6377 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.569418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c6c7-27c6-48f7-bcc4-01d9643b6377 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.569902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c6c7-27c6-48f7-bcc4-01d9643b6377 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.572235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 68/137] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:12.579424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.580028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.580549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.605569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:12.607187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:12.617906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 70/138] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:12.659424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945c6c7-27c6-48f7-bcc4-01d9643b6377 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.673297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945c6c7-27c6-48f7-bcc4-01d9643b6377 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.683097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.684908 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.685420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.685894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.702489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:12.710505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:12.713161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 69/139] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:12.719282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.730171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461b53b-9279-4813-8abe-1af2c81de65d None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.738867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.739904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.740402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.740900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.741858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:12.742357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.744228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.759364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 71/140] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.765606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.776564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187adf5-d8b7-4d81-b755-cef33faaafed admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.784483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.785388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.785671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.785947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.787289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.789508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.791259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 70/141] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.798716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.812907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bb6d8-0963-47da-8cab-1ce6af0a38b9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.822189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.823872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.824458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.824933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.839710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.842052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.857163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 72/142] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:12.863585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.882130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5470c-7f0f-4290-94a3-308cc8f2b0fe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.890405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92644a1a-0b09-4562-bea3-f67bbeb6c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.891315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92644a1a-0b09-4562-bea3-f67bbeb6c1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.891602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92644a1a-0b09-4562-bea3-f67bbeb6c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.891890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92644a1a-0b09-4562-bea3-f67bbeb6c1a0 admin admin] PATH_INFO: `/v3/projects/83d9ff3d963340b99d57cbb22d01eef9` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.893120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92644a1a-0b09-4562-bea3-f67bbeb6c1a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=83d9ff3d963340b99d57cbb22d01eef9)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.895254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92644a1a-0b09-4562-bea3-f67bbeb6c1a0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.896954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 71/143] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/projects/83d9ff3d963340b99d57cbb22d01eef9 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.904246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:12.920675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e394d4-f54a-466c-8f31-a143dbe2ed55 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:12.930939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:12.931926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.932476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.932926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.933942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] RBAC: Adding query filter params (role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=83d9ff3d963340b99d57cbb22d01eef9, user.id=ce757ce3882c4a3787f07fc82ba39a09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:12.934426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:12.936488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6784c-d0ff-41aa-9344-98eba0c7252c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:12.949879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf689ad-bc0c-41d2-92ab-e82198d29210 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.950169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf689ad-bc0c-41d2-92ab-e82198d29210 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.950458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf689ad-bc0c-41d2-92ab-e82198d29210 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.951586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 73/144] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:12 2021] GET /identity/v3/role_assignments?user.id=ce757ce3882c4a3787f07fc82ba39a09&scope.project.id=83d9ff3d963340b99d57cbb22d01eef9&role.id=322777f2a56841baaad99b09485c4a0e => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:12.952603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 72/145] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:12.959668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:12.960284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:12.960742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:12.998077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:13.000171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:13.014049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 74/146] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:13.057918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf689ad-bc0c-41d2-92ab-e82198d29210 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.078788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf689ad-bc0c-41d2-92ab-e82198d29210 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.086388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.087239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.087526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.087811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.111533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:13.118641 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:13.120461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 73/147] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:13.127379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.144938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e08dc-d79b-45ff-8932-2dd5c6085439 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.155309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.156272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.156753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.157315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.158293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:13.158836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.160665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.172377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 75/148] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.178985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.196078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87cbf-1909-4f8f-b256-fce36a652266 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.206708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.207613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.207899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.208181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.209530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.211395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.213044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 74/149] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.220133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.236199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149ae5b-10ee-408a-a42a-e1a231aecc83 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.247547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.248565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.249044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.249557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.266607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.268769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.284636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 76/150] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:13.291959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.308528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53333b-4397-43b2-8202-92a1d8c617b9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.318381 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294eece7-277e-4041-85c9-0e8525297e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.319319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294eece7-277e-4041-85c9-0e8525297e1e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.319606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294eece7-277e-4041-85c9-0e8525297e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.319949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294eece7-277e-4041-85c9-0e8525297e1e admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.321254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294eece7-277e-4041-85c9-0e8525297e1e admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.323446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294eece7-277e-4041-85c9-0e8525297e1e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.325775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 75/151] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.332335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.348536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8930ad-0665-49f0-b26f-ddc7908a7a08 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.357694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.358810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.359338 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.359830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.360980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0, user.id=d7499c7d953346c79b8adf6b0557fa02) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:13.361684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.364018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b44667-6e31-4c66-91cd-517de0dffd5b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.375876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 77/152] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/role_assignments?user.id=d7499c7d953346c79b8adf6b0557fa02&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.439904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58525f-8918-46f4-9828-ca9a19082caa None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.440212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58525f-8918-46f4-9828-ca9a19082caa None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.440471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58525f-8918-46f4-9828-ca9a19082caa None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.442296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 76/153] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:13.448920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.449300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.449487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.480570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:13.481797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:13.489870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 78/154] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:13.533790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58525f-8918-46f4-9828-ca9a19082caa None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.550770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58525f-8918-46f4-9828-ca9a19082caa None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.558962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.560216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.560725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.561200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.583508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:13.591959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:13.593898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 77/155] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:13.600659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.616159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cb64c-d4b6-4162-8e54-46cba294e5f6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.627051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.627753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.628033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.628302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.629076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:13.629377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.631138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.647108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 79/156] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.654237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.668868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eed8c-7a61-444b-ab64-60de85c5b7cf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.674590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.675820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.676306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.676781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.678246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.680878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.682934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 78/157] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.689819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.704726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d6fdd-1a45-43e7-8f2a-ebfb19b6bd1d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.710902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.711562 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.711843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.712117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.724014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.725815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.739044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 80/158] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:13.747051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.758753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97169d39-2275-4caf-9e3c-d72c2f1b0a81 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.764400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f190-337e-400a-a6d0-d1dbe22c5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.765592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f190-337e-400a-a6d0-d1dbe22c5b1a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.766103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f190-337e-400a-a6d0-d1dbe22c5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.766620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f190-337e-400a-a6d0-d1dbe22c5b1a admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.768089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f190-337e-400a-a6d0-d1dbe22c5b1a admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.770384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f190-337e-400a-a6d0-d1dbe22c5b1a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.772475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 79/159] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:13.780049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:13.797159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bac6f-fdda-4371-bb08-2964065a47dd admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:13.811319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:13.812008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:13.812289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:13.812561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:13.813541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] RBAC: Adding query filter params (role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0, user.id=ce757ce3882c4a3787f07fc82ba39a09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:13.813712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:13.815619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc69fd5-9b53-417d-b551-1c677d58794c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:13.822208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 81/160] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:13 2021] GET /identity/v3/role_assignments?user.id=ce757ce3882c4a3787f07fc82ba39a09&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:14.504478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7574380-b10e-416a-8101-e4913085c70e None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.504882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7574380-b10e-416a-8101-e4913085c70e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.505020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7574380-b10e-416a-8101-e4913085c70e None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.507004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 80/161] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:14.513587 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.513901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.514152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.537307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:14.538516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:14.551167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 82/162] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:14.581703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7574380-b10e-416a-8101-e4913085c70e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:14.599113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7574380-b10e-416a-8101-e4913085c70e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:14.603647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:14.605068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.605326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.605586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.624040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:14.633688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:14.636221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 81/163] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:14.642547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:14.653458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd600112-a379-4b83-bf38-4fb2a9aee8c9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:14.658159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:14.658870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.659155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.659431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.660183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:14.660485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:14.662100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:14.674697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 83/164] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:14.678534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:14.692317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0448da-3430-4382-8bba-f1d9bb4fcfda admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:14.698347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:14.699672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.700066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.700448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.722878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:14.725726 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:14.727811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 82/165] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:14 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:14.734790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:14.746283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cae4f-b2a4-4745-90e8-fc7eaf8da119 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:14.751317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:14.752236 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.752787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.753257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.763156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:14.765358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:14.776390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 84/166] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:14.784078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:14.795141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29944647-c061-4f26-9865-6233be684f9f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:14.800049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7bf4-8e2c-40f2-99f5-5236b2e69ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:14.801199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7bf4-8e2c-40f2-99f5-5236b2e69ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.801745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7bf4-8e2c-40f2-99f5-5236b2e69ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.802218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7bf4-8e2c-40f2-99f5-5236b2e69ac4 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.803635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7bf4-8e2c-40f2-99f5-5236b2e69ac4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:14.805996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7bf4-8e2c-40f2-99f5-5236b2e69ac4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:14.808759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 83/167] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:14 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:14.815727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:14.825663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711280b-c6e2-4b77-b942-34987349987b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:14.830680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:14.831645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:14.832158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:14.832623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:14.833699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] RBAC: Adding query filter params (role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=1312f09679814848855420c41dd2ec09, user.id=2418235fca724946b472cf4911af5dd3) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:14.834216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:14.836333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8752ef-ee5c-4671-ba0f-fb63c876541c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:14.842863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 85/168] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:14 2021] GET /identity/v3/role_assignments?user.id=2418235fca724946b472cf4911af5dd3&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=322777f2a56841baaad99b09485c4a0e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:15.086262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a669eb-a837-43a6-8df3-48f15b658d6e None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.086587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a669eb-a837-43a6-8df3-48f15b658d6e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.086791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a669eb-a837-43a6-8df3-48f15b658d6e None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.088992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 84/169] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:15.095573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78f53-4fa0-4ba8-8365-d747c09fb841 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.096199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78f53-4fa0-4ba8-8365-d747c09fb841 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.096875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78f53-4fa0-4ba8-8365-d747c09fb841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.116635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f2e78f53-4fa0-4ba8-8365-d747c09fb841 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:15.118203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f2e78f53-4fa0-4ba8-8365-d747c09fb841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:15.126928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 86/170] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:15.152281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a669eb-a837-43a6-8df3-48f15b658d6e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.165266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a669eb-a837-43a6-8df3-48f15b658d6e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.165603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aeafe-5dfd-4f8b-82be-dd78bfd0dcb7 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.166245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aeafe-5dfd-4f8b-82be-dd78bfd0dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.167181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aeafe-5dfd-4f8b-82be-dd78bfd0dcb7 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.169809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 87/171] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:15.170260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.171213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.171523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.171770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.175968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.176537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.177113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.183669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:15.192432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:15.192432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 85/172] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:15.197767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:15.199385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.199720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:15.207993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 88/173] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:15.210379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0251b31-99b1-47e7-8f11-7e4a0219772a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.222581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.222581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.222581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.222581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.222923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:15.222923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.223462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.232648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.233858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 86/174] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:15.239962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.242166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f66308-fdbb-452e-8e25-a61fc5df349b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.247645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.248566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.248913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.249256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.251289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43355e0-0e23-4e3b-beb5-32af41bf5ed9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.257116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.258073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.258456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.258861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.260160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.261850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:15.262313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.264223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 87/175] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:15.269877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.270529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:15.271995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 89/176] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:15.281899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.283489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cecbc6-8a2a-4320-9a94-9255f138e201 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.292938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.293910 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.294468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.294959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.295883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87c38-df0e-422c-8683-e9d05ef09a4a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.300638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.301299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.301580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.301855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.302958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:15.303262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.308372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.310839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.312788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.315778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 90/177] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:15.321912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.325940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 88/178] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:15.332823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.335221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4bac4-25af-47e9-b3ef-fc5c8a4db171 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.340924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.342287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.342764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.343085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.344424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.344884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c93e73-ed6c-49b7-8e69-722abc52f634 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.346679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.348739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 91/179] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:15.350044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.351159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.351628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.352103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.353531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.355197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.356753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.358683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 89/180] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:15.365638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.368571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fa651-9c2b-4353-a8d6-fe76f5d83a6e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.374364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.374798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.375081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.375402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.379306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80efc2-bad8-4ec0-832f-1b9e3f5b7f87 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.384275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.385408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.386457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.386940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.387446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.388523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=1312f09679814848855420c41dd2ec09, user.id=d7499c7d953346c79b8adf6b0557fa02) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:15.389118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.390909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.391539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.404218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 92/182] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:15.404592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 90/182] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/role_assignments?user.id=d7499c7d953346c79b8adf6b0557fa02&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:15.412660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.423082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef77e7a-3b68-4633-b702-faac7e7a0e3f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.428135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060d5d6-fdd2-4e18-964f-7b81c6a33af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.429370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060d5d6-fdd2-4e18-964f-7b81c6a33af0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.429892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060d5d6-fdd2-4e18-964f-7b81c6a33af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.430352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060d5d6-fdd2-4e18-964f-7b81c6a33af0 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.433162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060d5d6-fdd2-4e18-964f-7b81c6a33af0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.436784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060d5d6-fdd2-4e18-964f-7b81c6a33af0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.440230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 93/183] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:15.448557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.463098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cfff1-cd0a-45b8-aff5-4fff93743112 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.468843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.469898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.470362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.470918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.472913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979ee6-6af2-4363-9998-684401972876 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.473240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979ee6-6af2-4363-9998-684401972876 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.473514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979ee6-6af2-4363-9998-684401972876 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.475640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 94/184] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:15.476067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] RBAC: Adding query filter params (role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=1312f09679814848855420c41dd2ec09, user.id=2418235fca724946b472cf4911af5dd3) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:15.476720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.479177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.482784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.483060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.483340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.487321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 91/185] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/role_assignments?user.id=2418235fca724946b472cf4911af5dd3&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:15.507311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:15.509213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:15.519127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 95/186] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:15.543455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.554132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b892d5-b312-44d0-94bd-60c0f99e1bbc admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.560158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886efe6-a5c2-4b8d-b141-99a9b259a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.561027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886efe6-a5c2-4b8d-b141-99a9b259a685 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.561310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886efe6-a5c2-4b8d-b141-99a9b259a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.561581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886efe6-a5c2-4b8d-b141-99a9b259a685 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.562918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886efe6-a5c2-4b8d-b141-99a9b259a685 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.564697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886efe6-a5c2-4b8d-b141-99a9b259a685 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.566954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 92/187] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:15.574195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:15.589166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230b36-117d-4395-8277-4ab768cf5beb None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:15.594964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:15.595628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:15.595909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:15.596229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] PATH_INFO: `/v3/groups` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:15.596928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:15.598027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:15.598027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:15.598027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:15.599542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b5a31-0742-403a-881f-14f940c81fe3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:15.674529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 96/188] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Aug 27 03:44:15 2021] POST /identity/v3/groups => generated 229 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:17.134235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfef3a-7b64-463f-8805-062b89f28942 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.134798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfef3a-7b64-463f-8805-062b89f28942 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.134798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfef3a-7b64-463f-8805-062b89f28942 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.137445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 93/189] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:17.143765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.144225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.144397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.171682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:17.173193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:17.181176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 97/190] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:17.205527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfef3a-7b64-463f-8805-062b89f28942 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.221578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfef3a-7b64-463f-8805-062b89f28942 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.226088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.226931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.227215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.227488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.239667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:17.247330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:17.248578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 94/191] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:17.254981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.264568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d66c59-1d5d-4140-a708-9139693a0368 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.269482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.270406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.270911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.271395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.272352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:17.272873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.274735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.284056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 98/192] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:17.292649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.303640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9f71f-cac4-4f2c-9d38-f3037687695a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.309124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.310059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.310343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.310645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.311871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.314016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.315988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 95/193] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:17.322112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.334139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82991f3-9509-4afb-822f-d30c0eae47c2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.339053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab4b24-acdf-48f7-ba36-f9de33e4f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.339939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab4b24-acdf-48f7-ba36-f9de33e4f727 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.340218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab4b24-acdf-48f7-ba36-f9de33e4f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.340495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab4b24-acdf-48f7-ba36-f9de33e4f727 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.341744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab4b24-acdf-48f7-ba36-f9de33e4f727 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.343948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab4b24-acdf-48f7-ba36-f9de33e4f727 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.345791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 99/194] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:17.352178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.362862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be935-c097-43b8-9026-33eb88faeb7e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.367406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b43c23-4b0d-4a56-9a42-b08aa04384d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.368306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b43c23-4b0d-4a56-9a42-b08aa04384d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.368585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b43c23-4b0d-4a56-9a42-b08aa04384d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.368859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b43c23-4b0d-4a56-9a42-b08aa04384d8 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09/users/2418235fca724946b472cf4911af5dd3/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.370941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b43c23-4b0d-4a56-9a42-b08aa04384d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312f09679814848855420c41dd2ec09, user_id=2418235fca724946b472cf4911af5dd3, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.373717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b43c23-4b0d-4a56-9a42-b08aa04384d8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.460442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 96/195] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:17 2021] PUT /identity/v3/projects/1312f09679814848855420c41dd2ec09/users/2418235fca724946b472cf4911af5dd3/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:17.711086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563aaf-aa13-4727-8f17-036d8f65fd64 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.711469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563aaf-aa13-4727-8f17-036d8f65fd64 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.711637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563aaf-aa13-4727-8f17-036d8f65fd64 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.714389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 100/196] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:17.720750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.721042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.721322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.740678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306dea-f7d0-40bd-9a8a-92cb0a3b4685 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.740977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306dea-f7d0-40bd-9a8a-92cb0a3b4685 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.741224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306dea-f7d0-40bd-9a8a-92cb0a3b4685 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.742060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:17.743223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 101/197] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:17.743996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:17.749885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.750172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.750457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.769162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:17.770374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:17.808175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 97/198] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:17.834480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.844238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90532-9356-4a89-8cf9-9b397ececa87 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.846760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 102/199] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:17.854468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.855179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.855530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.855839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.868151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:17.876073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:17.877241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.880314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 98/200] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:17.887474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.887657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbb51a-a084-41c0-a066-4ff7e192deb2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.892276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.893102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.893385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.893661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.901238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eeeca-561e-470a-94fc-8b205eaae32d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.909800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.910857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.913650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.913650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.913800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:17.913869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:17.913869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.915554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.920575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:17.926694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 103/201] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:17.928268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 99/202] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:17.931915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.935025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.944581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a39e75-a635-4688-b413-a569677b0830 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.944732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d7388-41b5-489b-acf5-88052b0eb293 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.949333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.949843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525bf2f-6347-4dad-87b6-56589bfb04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.950103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.950387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.950703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.950798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bf2f-6347-4dad-87b6-56589bfb04e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.951016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bf2f-6347-4dad-87b6-56589bfb04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.951291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bf2f-6347-4dad-87b6-56589bfb04e1 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.951457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:17.951766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.952638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525bf2f-6347-4dad-87b6-56589bfb04e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.953372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bb2cf-e438-4a3e-89f0-0d68752f338f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.954429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525bf2f-6347-4dad-87b6-56589bfb04e1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.956107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 100/203] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:17.957387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474f72-053d-478c-bbe3-6944616a2c67 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.957681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474f72-053d-478c-bbe3-6944616a2c67 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.957959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474f72-053d-478c-bbe3-6944616a2c67 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.959788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 101/204] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:17.961971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474f72-053d-478c-bbe3-6944616a2c67 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:17.967051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 104/205] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:17.969716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.970019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.970293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.981835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474f72-053d-478c-bbe3-6944616a2c67 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:17.986813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:17.987682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:17.987895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:17.988148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:17.989333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:17.989892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:17.991256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:17.991462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:17.994201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 102/206] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:17.994201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:18.005557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103f611-fb5b-462c-a717-bfb2cc6dd437 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:18.005744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 105/207] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:18.011967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:18.020507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:18.021389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:18.021672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:18.021949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:18.024181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:18.026661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:18.028380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 103/208] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:17 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:18.029139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:18.032899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9190cbe-d2c8-46dd-969f-ed970145a0e1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:18.037293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:18.038193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:18.038476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:18.038779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09/users/d7499c7d953346c79b8adf6b0557fa02/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:18.043150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312f09679814848855420c41dd2ec09, user_id=d7499c7d953346c79b8adf6b0557fa02, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:18.043557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a5c1-b270-46be-b79b-4ed795734a8a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:18.045832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:18.048281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:18.049338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:18.049338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:18.049619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:18.050773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:18.052453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:18.054257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 104/209] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:18.054823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:18.065085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b29bc9-fd15-4ac6-b67c-e86375a068e3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:18.069541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:18.070392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:18.070699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:18.071030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:18.072231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:18.074372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:18.081370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 105/210] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:18 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:18.081370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:18.090951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3ec42-ae28-43f2-822c-c47837bbf64c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:18.095332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:18.095988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:18.096267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:18.096542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] PATH_INFO: `/v3/groups` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:18.102670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:18.102670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:18.102670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:18.102670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:18.102670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e359bd-1087-4e7a-bed2-f8e51cca1153 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:18.133570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 106/211] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:18 2021] PUT /identity/v3/projects/1312f09679814848855420c41dd2ec09/users/d7499c7d953346c79b8adf6b0557fa02/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:18.134469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:18.216102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 106/212] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Aug 27 03:44:18 2021] POST /identity/v3/groups => generated 226 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:18.219041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fadc-9744-4261-96c3-3e4a0f47d063 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:18.224035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8779bd-b7a7-4c58-9dc9-7bd19845bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:18.224976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8779bd-b7a7-4c58-9dc9-7bd19845bf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:18.225261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8779bd-b7a7-4c58-9dc9-7bd19845bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:18.225537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8779bd-b7a7-4c58-9dc9-7bd19845bf2e admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09/users/2418235fca724946b472cf4911af5dd3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:18.228138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8779bd-b7a7-4c58-9dc9-7bd19845bf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312f09679814848855420c41dd2ec09, user_id=2418235fca724946b472cf4911af5dd3, role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:18.231929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8779bd-b7a7-4c58-9dc9-7bd19845bf2e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:18.353114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 107/213] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:18 2021] PUT /identity/v3/projects/1312f09679814848855420c41dd2ec09/users/2418235fca724946b472cf4911af5dd3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:19.849530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc685-01e5-406d-ba89-c8b683e29134 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:19.850146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc685-01e5-406d-ba89-c8b683e29134 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:19.850146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecc685-01e5-406d-ba89-c8b683e29134 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:19.852091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 107/214] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:19.867572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:19.868217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:19.868217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:19.891697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:19.892935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:19.974366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 108/215] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:20.007702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc685-01e5-406d-ba89-c8b683e29134 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.031232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecc685-01e5-406d-ba89-c8b683e29134 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.041249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.042652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.042932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.043206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.063512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:20.070493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:20.071983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 108/216] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:20.080354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.093339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbf423-19fe-46b7-ad88-6ff3070d7864 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.104382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.105638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.105927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.106211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.107037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:20.107349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:20.109160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:20.127255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 109/217] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:20.135776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.152758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860e5e-f088-4128-902d-f61f52d88d89 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.162459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.163387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.163667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.163941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.167626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:20.169804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:20.171548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 109/218] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:20.178928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.195975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc41f7-d963-4a43-bda8-ceb2d170ad0c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.206877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.207557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.207840 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.208118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.226431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:20.228253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:20.244947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 110/219] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:20.251872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.267232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4e14-c324-4ea2-a244-a2fbffe2cd8d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.279216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635b1d5-9bfd-4c42-953f-a5c3e1652982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.280101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635b1d5-9bfd-4c42-953f-a5c3e1652982 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.280386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635b1d5-9bfd-4c42-953f-a5c3e1652982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.280663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635b1d5-9bfd-4c42-953f-a5c3e1652982 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.281964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635b1d5-9bfd-4c42-953f-a5c3e1652982 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:20.284059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635b1d5-9bfd-4c42-953f-a5c3e1652982 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:20.285793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 110/220] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:20.293275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.308545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758daa39-31c6-4436-874b-e20adbd9bc32 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.318712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.319388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.319670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.319946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.320795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] RBAC: Adding query filter params (role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=1312f09679814848855420c41dd2ec09, user.id=2418235fca724946b472cf4911af5dd3) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:20.321109 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:20.327178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99412-3189-4173-a4ff-7b67c92e666b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:20.334062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 111/221] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/role_assignments?user.id=2418235fca724946b472cf4911af5dd3&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=322777f2a56841baaad99b09485c4a0e => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.196421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467245eb-dda7-4ccf-845b-ed92b8b3ba98 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.197118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467245eb-dda7-4ccf-845b-ed92b8b3ba98 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.197118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467245eb-dda7-4ccf-845b-ed92b8b3ba98 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.199792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 111/222] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:21.205707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.206319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.206319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.227683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:21.229424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.241194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 112/223] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:21.274926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467245eb-dda7-4ccf-845b-ed92b8b3ba98 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.288436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467245eb-dda7-4ccf-845b-ed92b8b3ba98 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.293623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.294427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.294833 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.295112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.306633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:21.314258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:21.315540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 112/224] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:21.322238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.332309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d8cd-c7b6-4477-a0f2-02c58f73d59b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.338731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.339424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.339707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.339992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.340760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:21.341076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.342750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.356946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 113/225] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.363231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.374498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a97e92-9133-4e39-8631-920d67008747 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.379131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.380010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.380291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.380568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.383310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.385754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.387603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 113/226] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.394608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.404958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcfab4-089d-4c5e-bfcd-189c3dcfedc2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.414856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.415537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.415881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.416164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.425527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.427344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.442657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 114/227] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:21.450148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.460745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757696a-aa97-47ae-a7c7-946dc1110a87 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.468956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddea37-4b02-4e66-a517-537612d6cdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.469834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddea37-4b02-4e66-a517-537612d6cdbc admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.470115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddea37-4b02-4e66-a517-537612d6cdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.470390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddea37-4b02-4e66-a517-537612d6cdbc admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.471624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddea37-4b02-4e66-a517-537612d6cdbc admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.473820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddea37-4b02-4e66-a517-537612d6cdbc admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.475808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 114/228] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.482835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.492045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4d65-4016-41b1-80cd-e70a53479a00 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.499135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.499808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.500092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.500366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.501216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=1312f09679814848855420c41dd2ec09, user.id=d7499c7d953346c79b8adf6b0557fa02) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:21.501528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.503438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7f98e-f777-4901-8668-e91020673504 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.510049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 115/229] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/role_assignments?user.id=d7499c7d953346c79b8adf6b0557fa02&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.573487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071fea-be83-4ed4-be2d-c0cc09d3408f None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.573939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071fea-be83-4ed4-be2d-c0cc09d3408f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.574194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071fea-be83-4ed4-be2d-c0cc09d3408f None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.576030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 115/230] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:21.590058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.590369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.590631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.620178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:21.621518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.629772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 116/231] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:21.675172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071fea-be83-4ed4-be2d-c0cc09d3408f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.694220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071fea-be83-4ed4-be2d-c0cc09d3408f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.699577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.700402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.700683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.700958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.718518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:21.725866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:21.727386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 116/232] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:21.734413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.743866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbf37b-f05e-488f-b8ce-92eb1b133943 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.755138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.755828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.756110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.756384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.757148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:21.757454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.759121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c5ec-374f-4a4b-93f6-e921e3ddefab admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.768394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 117/233] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.774881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.786408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486940-2c80-4dbf-b163-7e56d2813c0a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.795666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdbfcf-2f02-4a31-989a-410177be6e9e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.795962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdbfcf-2f02-4a31-989a-410177be6e9e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.796210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdbfcf-2f02-4a31-989a-410177be6e9e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.798007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 118/234] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:21.801250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d496a3-0efd-43e5-bdcf-09abf0fa2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.802129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d496a3-0efd-43e5-bdcf-09abf0fa2bfe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.802407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d496a3-0efd-43e5-bdcf-09abf0fa2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.802715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d496a3-0efd-43e5-bdcf-09abf0fa2bfe admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.803934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d496a3-0efd-43e5-bdcf-09abf0fa2bfe admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.806090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d496a3-0efd-43e5-bdcf-09abf0fa2bfe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.808354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 117/235] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.815376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdbfcf-2f02-4a31-989a-410177be6e9e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.831475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.832004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.832492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.840959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdbfcf-2f02-4a31-989a-410177be6e9e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.863417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.864149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.864439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.864718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.871414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:21.872652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.877783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.879723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.895672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 118/236] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:21.897074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 119/237] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:21.917636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.933039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf7e24-3583-4105-b17b-7d0616cedcf3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.940896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.940896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.940896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.940896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.944353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.944950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.947016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 119/238] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:21.953874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.955130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.967506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad388-af06-463e-ac93-1d1677998695 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.969387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22717344-f1bd-49ea-8792-7f7ce2879c1b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.973680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.974811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.975267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.976302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.985929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.986526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.986839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.987121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.990583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] RBAC: Adding query filter params (role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=1312f09679814848855420c41dd2ec09, user.id=2418235fca724946b472cf4911af5dd3) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:21.990583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.990583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.001871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:22.005281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 120/239] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/role_assignments?user.id=2418235fca724946b472cf4911af5dd3&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.014670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:22.016395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 120/240] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:22.023356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.036564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c1c31-0ce3-4cab-9351-73b6bcdadd08 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.047218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.047912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.048196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.048473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.049262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:22.049571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.051303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.067086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 121/241] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.073597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.092816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952ce5-5864-4231-ac4a-8fc63bb90102 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.102743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.104532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.105152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.105745 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.118799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.121136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.137405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 121/242] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:22.144365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.165304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d287e54-a17c-4814-aa50-7eb6d710f0b3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.171493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.172374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.172665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.172943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.175419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.177553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.179902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 122/243] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.187410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.199086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43fe8-a9d9-4707-8f26-bad813e66343 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.204901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.206049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.206988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.207454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.217321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.218782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:22.218782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:22.218782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:22.220377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabc3b-3ed5-4288-8b8c-e6a36f964828 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.222372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 122/244] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.229948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.243539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd196e-80e1-4acc-b125-c431c13243c9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.252481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.253162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.253497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.253780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.254691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:22.255007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.256988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350304e9-43c4-4688-b403-48eb577f8104 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.264052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 123/245] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=322777f2a56841baaad99b09485c4a0e => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.562730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32d2d-1371-4d1d-b4a8-6f9b327da2b2 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.563367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32d2d-1371-4d1d-b4a8-6f9b327da2b2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.563853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32d2d-1371-4d1d-b4a8-6f9b327da2b2 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.565965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 123/246] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:22.573440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.573736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.574002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.599172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:22.600397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:22.613012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 124/247] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:22.653776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c32d2d-1371-4d1d-b4a8-6f9b327da2b2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.671657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c32d2d-1371-4d1d-b4a8-6f9b327da2b2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.676743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.677869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.678362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.678852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.696369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:22.705439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:22.707383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 124/248] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:22.713768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.727913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0165-39d0-4ba9-bcc0-87aa08315541 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.737770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.738895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.739374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.739822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.740766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:22.741277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.743299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.755450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 125/249] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.763018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.780543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d2d2-d831-4836-995e-154a2df7a7ed admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.790412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.791101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.792557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.792841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.806385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.808922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.820598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 125/250] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:22.829008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.840057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c5d2-330c-48d9-83b2-0e91c76d3dc8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.845583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.846870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.847438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.847925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.850728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.853143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.855208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 126/251] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.862154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.873336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fa0f-6016-40f8-b62e-5f296701bd43 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.883109 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cf104-76a9-4cbb-be02-c9e0ca28e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.884421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cf104-76a9-4cbb-be02-c9e0ca28e9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.885050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cf104-76a9-4cbb-be02-c9e0ca28e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.886045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cf104-76a9-4cbb-be02-c9e0ca28e9a5 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.891376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cf104-76a9-4cbb-be02-c9e0ca28e9a5 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.893701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cf104-76a9-4cbb-be02-c9e0ca28e9a5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.895688 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 126/252] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:22.902482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:22.913705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0c08f-fc71-4161-8301-020b5e8afc63 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:22.920669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:22.921723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:22.922265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:22.922770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:22.923886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:22.924398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:22.926764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1789631-f1c6-434b-9241-0db4e192d9a2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:22.939145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 127/253] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:22 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:23.297986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50a48-e96d-4863-94c4-85929ea11f12 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.298515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50a48-e96d-4863-94c4-85929ea11f12 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.298515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50a48-e96d-4863-94c4-85929ea11f12 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.300708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 127/254] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:23.308359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.308854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.308854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.331769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:23.332987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:23.346344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 128/255] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:23.380598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50a48-e96d-4863-94c4-85929ea11f12 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.396277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50a48-e96d-4863-94c4-85929ea11f12 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.403627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.404438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.404719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.405033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.421335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:23.428667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:23.430227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 128/256] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:23.446830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.459770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5258-94ac-46a1-bf77-22c377681c32 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.465991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.466928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.467405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.467891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.469150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:23.469589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:23.471245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:23.484274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 129/257] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:23.491751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.503145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7882-93c8-49fc-ad46-477d07ad4fb7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.511786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.512528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.512874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.513150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.524249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:23.526297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:23.537687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 129/258] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:23.543988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.555784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3e560-5159-4b09-a97f-2841836f368c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.562690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.563603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.563899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.564175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.565411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:23.567635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:23.569400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 130/259] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:23.576305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.585866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e463f-ce66-4712-983d-bccc9fa3c170 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.592395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415dee3-a272-4d1a-9662-cdb53741f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.593311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415dee3-a272-4d1a-9662-cdb53741f9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.593593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415dee3-a272-4d1a-9662-cdb53741f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.593921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415dee3-a272-4d1a-9662-cdb53741f9c3 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.595198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415dee3-a272-4d1a-9662-cdb53741f9c3 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:23.597126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415dee3-a272-4d1a-9662-cdb53741f9c3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:23.598911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 130/260] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:23.605862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.616092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadfb39-d50b-4177-88d2-cda706d65427 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.621994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.622745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.623033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.623315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.624374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=1312f09679814848855420c41dd2ec09) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:23.624694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:23.626819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0cbb3-960e-44e7-b313-9aeb2b378b03 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:23.633102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 131/261] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=322777f2a56841baaad99b09485c4a0e => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.092570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a4c34-849c-426a-81b5-7407576f8fb3 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.092972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a4c34-849c-426a-81b5-7407576f8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.093150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a4c34-849c-426a-81b5-7407576f8fb3 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.095347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 131/262] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:24.101236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.101517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.101794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.131648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:24.132923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:24.141026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 132/263] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:24.192063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a4c34-849c-426a-81b5-7407576f8fb3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.207647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a4c34-849c-426a-81b5-7407576f8fb3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.212358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.213922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.214211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.214478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.230494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:24.238069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:24.239658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 132/264] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:24.246891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.256146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b0d13-f640-4134-94cc-689aa3baab4d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.262123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.262915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.263195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.263462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.264215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:24.264514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.266164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.276737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 133/265] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.282970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.294074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a52cc-450a-4322-af1d-d11eb616eb52 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.301927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.302677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.302964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.303239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.317463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.319294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.329692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 133/266] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:24.336279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.350220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed01-aaef-49b6-ae78-358d3980d1b5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.356169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.357093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.357371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.357642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.360014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.362125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.363899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 134/267] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.370410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.380174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014d32-31fe-4424-aced-0ece6d6b3a4d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.391213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ead01-043e-49aa-a39e-89aa3477aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.392190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ead01-043e-49aa-a39e-89aa3477aef0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.392471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ead01-043e-49aa-a39e-89aa3477aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.392799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ead01-043e-49aa-a39e-89aa3477aef0 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.394075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ead01-043e-49aa-a39e-89aa3477aef0 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.396196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ead01-043e-49aa-a39e-89aa3477aef0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.398230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 134/268] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.405340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.415665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df99ae-1b3e-4581-b0c7-88de56ad874e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.422088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.423000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.423279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.423552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.424667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=1312f09679814848855420c41dd2ec09) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:24.424985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.427046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae861e-085d-4ad4-9d18-0f9959e5a355 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.435169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 135/269] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.703804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f6a58-8c23-4b9a-8df7-eeecbd0d85d7 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.704220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f6a58-8c23-4b9a-8df7-eeecbd0d85d7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.704403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f6a58-8c23-4b9a-8df7-eeecbd0d85d7 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.706609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 135/270] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:24.714068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.714371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.714686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.739292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:24.740591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:24.753372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 136/271] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:24.789238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f6a58-8c23-4b9a-8df7-eeecbd0d85d7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.805313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f6a58-8c23-4b9a-8df7-eeecbd0d85d7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.812317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.813133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.813412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.813686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.831599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:24.843482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:24.844931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 136/272] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:24.851584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.863432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63bc82-0c7f-42d8-a468-96359b2eb11e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.871369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.872371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.872743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.873225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.874480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:24.874828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.876458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.888515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 137/273] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.894628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.906341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94382312-4208-468b-ae96-bb67b925e265 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.913507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.914184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.914472 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.914826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.931139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.933696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.943877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 137/274] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:24.951958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.962197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810d7a-a7bd-4abc-8fef-a910ce3b86d2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.970880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.971765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.972047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.972327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] PATH_INFO: `/v3/projects/d619747d92dd4ce8a23a9280f1833108` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.973628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] RBAC: Authorizing `identity:get_project(project_id=d619747d92dd4ce8a23a9280f1833108)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.975571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.977217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 138/275] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/projects/d619747d92dd4ce8a23a9280f1833108 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:24.986479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.997226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfe03-8b08-4b00-9fb1-de7e7c8db356 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.006822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897d791-6e9e-4d82-9fb7-3f26d328b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.007694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d791-6e9e-4d82-9fb7-3f26d328b07e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.007977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d791-6e9e-4d82-9fb7-3f26d328b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.008263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d791-6e9e-4d82-9fb7-3f26d328b07e admin admin] PATH_INFO: `/v3/groups/5d4f0ff411084fbd9518fa741b7b480a` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.023314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897d791-6e9e-4d82-9fb7-3f26d328b07e admin admin] RBAC: Authorizing `identity:get_group(group_id=5d4f0ff411084fbd9518fa741b7b480a)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:25.025261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897d791-6e9e-4d82-9fb7-3f26d328b07e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:25.028380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 138/276] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/groups/5d4f0ff411084fbd9518fa741b7b480a => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:25.034974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:25.047865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516539a-414c-47e6-9957-4a04f24c47ab admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.057835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.058632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.058921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.059194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.060039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] RBAC: Adding query filter params (group.id=5d4f0ff411084fbd9518fa741b7b480a, role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=d619747d92dd4ce8a23a9280f1833108) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:25.060350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:25.062423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e864b82-8612-453e-a388-304d4a2571e8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:25.070951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 139/277] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:25 2021] GET /identity/v3/role_assignments?group.id=5d4f0ff411084fbd9518fa741b7b480a&scope.project.id=d619747d92dd4ce8a23a9280f1833108&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:25.238529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671789-45d3-4708-afe7-c17715e1e32e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.238915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671789-45d3-4708-afe7-c17715e1e32e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.239083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671789-45d3-4708-afe7-c17715e1e32e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.240873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 139/278] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:25.253288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.253596 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.253852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.276450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:25.278248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:25.290041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 140/279] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:25.333097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671789-45d3-4708-afe7-c17715e1e32e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:25.352503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671789-45d3-4708-afe7-c17715e1e32e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.358615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.359497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.359784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.360063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.375405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:25.387223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:25.394603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 140/280] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:25.396930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:25.413172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d254c5-0f10-48f1-a01e-08d9e21e5a5c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.426039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.426751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.427038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.427315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.428086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:25.428394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:25.430010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:25.444664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 141/281] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:25.451069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:25.461350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b734f2e-ee8a-4326-95f5-24a7b5449da1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.470932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.471818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.472100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.472378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.475725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:25.477682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:25.480533 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 141/282] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:25 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:25.487020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:25.500961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5f060-0529-41b9-8427-b940eaa507da admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.507201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ca54-fedc-4287-b388-4e3f645db663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.508148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ca54-fedc-4287-b388-4e3f645db663 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.508429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ca54-fedc-4287-b388-4e3f645db663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.508705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ca54-fedc-4287-b388-4e3f645db663 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.511326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ca54-fedc-4287-b388-4e3f645db663 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:25.513593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ca54-fedc-4287-b388-4e3f645db663 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:25.515762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 142/283] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:25 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:25.521808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:25.532606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c870f-91c9-4abc-b7f1-b459c91567aa admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:25.546018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aba2ca-2763-4138-89c3-a56745926f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:25.546958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aba2ca-2763-4138-89c3-a56745926f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.547237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aba2ca-2763-4138-89c3-a56745926f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.547520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aba2ca-2763-4138-89c3-a56745926f1e admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.552060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aba2ca-2763-4138-89c3-a56745926f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3953d9945a8c4f53a64136a4286b7dd0, group_id=0df1d59216bf4cddaa5f79dcf19884b1, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:25.554756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aba2ca-2763-4138-89c3-a56745926f1e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:25.643354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 142/284] 10.222.0.73 () {58 vars in 1464 bytes} [Fri Aug 27 03:44:25 2021] PUT /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:25.919080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa55e-1617-4bce-9066-1a52bcd6d4df None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.919460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa55e-1617-4bce-9066-1a52bcd6d4df None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.919647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa55e-1617-4bce-9066-1a52bcd6d4df None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.921855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 143/285] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:25.929011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:25.929334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:25.929578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:25.959770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:25.961023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:26.044649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 143/286] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:26.075094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa55e-1617-4bce-9066-1a52bcd6d4df None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.091696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa55e-1617-4bce-9066-1a52bcd6d4df None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.097530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.098347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.098658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.098941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.114203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:26.123141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:26.124572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 144/287] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:26.130889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.143929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8f82-fdda-41d7-bb41-10ed317e2fd5 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.155597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.156363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.156679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.156960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.157730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:26.158038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.159717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.175168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 144/288] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:26.181137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.208713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f60c7-ce7f-4b6a-9e1a-e71f7bb08b82 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.218984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.219856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.220134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.220423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.227413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.229256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:26.229256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:26.229256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:26.230223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.232289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 145/289] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:26.238047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.251929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6798a1-537a-404a-8766-af028a2dad85 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.268073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c51b4-4966-4cc4-9622-a22b7ce75767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.268964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c51b4-4966-4cc4-9622-a22b7ce75767 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.269247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c51b4-4966-4cc4-9622-a22b7ce75767 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.269520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c51b4-4966-4cc4-9622-a22b7ce75767 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.275496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c51b4-4966-4cc4-9622-a22b7ce75767 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.277715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c51b4-4966-4cc4-9622-a22b7ce75767 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.279919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 145/290] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:26.286260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.299565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e4880-7d19-4c45-b670-aba64fe4880e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.307197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc81e31-fd08-4343-99a9-05eae17f6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.308177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc81e31-fd08-4343-99a9-05eae17f6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.308466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc81e31-fd08-4343-99a9-05eae17f6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.308745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc81e31-fd08-4343-99a9-05eae17f6ed6 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.315853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc81e31-fd08-4343-99a9-05eae17f6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3953d9945a8c4f53a64136a4286b7dd0, group_id=0df1d59216bf4cddaa5f79dcf19884b1, role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.318531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc81e31-fd08-4343-99a9-05eae17f6ed6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.397843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 146/291] 10.222.0.73 () {58 vars in 1464 bytes} [Fri Aug 27 03:44:26 2021] PUT /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:26.579303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d745a5-f27d-4f14-9dd8-079ab7e32272 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.580453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d745a5-f27d-4f14-9dd8-079ab7e32272 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.580453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d745a5-f27d-4f14-9dd8-079ab7e32272 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.581870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 146/292] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:26.600130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.600496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.600701 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.631776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:26.633070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:26.713680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 147/293] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:26.759307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d745a5-f27d-4f14-9dd8-079ab7e32272 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.779284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d745a5-f27d-4f14-9dd8-079ab7e32272 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.784087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.784834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.785118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.785395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.800327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:26.807465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:26.809826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 147/294] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:26.815251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.828259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac7d7c-1dee-4720-a5f4-0546831c815c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.835049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.835670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.835953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.836231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.836994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:26.837301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.839587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.852405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 148/295] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:26.859836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.871046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea9395-b164-4e76-8be4-2bf49b0b3868 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.875805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.876773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.877057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.877387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.878720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.881107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.882850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 148/296] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:26.890044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.901124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a27dad-d1b1-4b48-82e8-401071de3167 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.906110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb671599-1943-4b3a-bd9f-7a5b229cb931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.907253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb671599-1943-4b3a-bd9f-7a5b229cb931 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.907536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb671599-1943-4b3a-bd9f-7a5b229cb931 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.907812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb671599-1943-4b3a-bd9f-7a5b229cb931 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.909174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb671599-1943-4b3a-bd9f-7a5b229cb931 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.911381 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb671599-1943-4b3a-bd9f-7a5b229cb931 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:26.913524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 149/297] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:26 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:26.920218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:26.936798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef3ef-e707-4af8-ae98-90104f753e43 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:26.942836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5adc32-6588-4207-9a3e-29f1d2a4aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:26.943788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5adc32-6588-4207-9a3e-29f1d2a4aecd admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:26.944067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5adc32-6588-4207-9a3e-29f1d2a4aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:26.944341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5adc32-6588-4207-9a3e-29f1d2a4aecd admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:26.952263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5adc32-6588-4207-9a3e-29f1d2a4aecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312f09679814848855420c41dd2ec09, group_id=0df1d59216bf4cddaa5f79dcf19884b1, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:26.955127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5adc32-6588-4207-9a3e-29f1d2a4aecd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:27.020148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 149/298] 10.222.0.73 () {58 vars in 1464 bytes} [Fri Aug 27 03:44:26 2021] PUT /identity/v3/projects/1312f09679814848855420c41dd2ec09/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:27.139676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25c6d-f6aa-4757-b741-0fea6976c7cc None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.139978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25c6d-f6aa-4757-b741-0fea6976c7cc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.140130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25c6d-f6aa-4757-b741-0fea6976c7cc None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.142255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 150/299] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:27.148288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.148620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.148858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.174244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:27.175557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:27.263600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 150/300] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:27.287392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25c6d-f6aa-4757-b741-0fea6976c7cc None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:27.307588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25c6d-f6aa-4757-b741-0fea6976c7cc None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:27.316087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:27.316959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.317295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.317567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.332099 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:27.339843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:27.345544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 151/301] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:27.351861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:27.363560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a321-465f-40fd-b038-8badcae0ef31 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:27.375236 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:27.375929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.376217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.376494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.377265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:27.377578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:27.379245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:27.391111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 151/302] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:27.395636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:27.411850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b37a4-0888-48bd-a090-d9450b1ec459 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:27.420291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:27.421462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.421894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.422415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.425150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:27.428562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:27.431481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 152/303] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:27 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:27.437809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:27.454851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f918a5-bccb-434d-9842-987a17766c76 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:27.462395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5efafb-5e58-4043-a9c2-5c47e304be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:27.463939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efafb-5e58-4043-a9c2-5c47e304be43 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.464289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efafb-5e58-4043-a9c2-5c47e304be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.464572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efafb-5e58-4043-a9c2-5c47e304be43 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.470958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5efafb-5e58-4043-a9c2-5c47e304be43 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:27.473053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5efafb-5e58-4043-a9c2-5c47e304be43 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:27.475251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 152/304] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:27 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:27.482127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:27.493855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935e4c8-88ca-49d9-ab93-dbdc7528573e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:27.501851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823073d-5600-49ba-8baf-40860ff0390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:27.502971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823073d-5600-49ba-8baf-40860ff0390a admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:27.503255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823073d-5600-49ba-8baf-40860ff0390a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:27.503533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823073d-5600-49ba-8baf-40860ff0390a admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:27.508792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823073d-5600-49ba-8baf-40860ff0390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312f09679814848855420c41dd2ec09, group_id=0df1d59216bf4cddaa5f79dcf19884b1, role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:27.512707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823073d-5600-49ba-8baf-40860ff0390a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:27.614260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 153/305] 10.222.0.73 () {58 vars in 1464 bytes} [Fri Aug 27 03:44:27 2021] PUT /identity/v3/projects/1312f09679814848855420c41dd2ec09/groups/0df1d59216bf4cddaa5f79dcf19884b1/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:28.200451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e24e-774d-4a04-9234-c2acafb8dcb4 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.201480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e24e-774d-4a04-9234-c2acafb8dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.201480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e24e-774d-4a04-9234-c2acafb8dcb4 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.204009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 153/306] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:28.211000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.211346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.211639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.236404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:28.237732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:28.321287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 154/307] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:28.345359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e24e-774d-4a04-9234-c2acafb8dcb4 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:28.360943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e24e-774d-4a04-9234-c2acafb8dcb4 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:28.366328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:28.367206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.367490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.367821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.386159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:28.396420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:28.397670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 154/308] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:28.404818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:28.415082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215e211-2a4b-44a7-b79c-000f2fa121c7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:28.422169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:28.422937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.423222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.423666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.424440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:28.424746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:28.426415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:28.439171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 155/309] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:28.445414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:28.459986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327b929-6f9f-4849-a75f-9443ba298d11 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:28.468815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:28.469690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.470021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.470303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] PATH_INFO: `/v3/groups/5d4f0ff411084fbd9518fa741b7b480a` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.471581 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] RBAC: Authorizing `identity:get_group(group_id=5d4f0ff411084fbd9518fa741b7b480a)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:28.473568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:28.475299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 155/310] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:28 2021] GET /identity/v3/groups/5d4f0ff411084fbd9518fa741b7b480a => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:28.482355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:28.493490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a394fa6-06ba-46ac-ba21-1bc6b8ce5025 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:28.499928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c4ba-eb22-4e4f-974e-40c72c7ab550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:28.500855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c4ba-eb22-4e4f-974e-40c72c7ab550 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.501135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c4ba-eb22-4e4f-974e-40c72c7ab550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.501456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c4ba-eb22-4e4f-974e-40c72c7ab550 admin admin] PATH_INFO: `/v3/projects/d619747d92dd4ce8a23a9280f1833108` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.507511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c4ba-eb22-4e4f-974e-40c72c7ab550 admin admin] RBAC: Authorizing `identity:get_project(project_id=d619747d92dd4ce8a23a9280f1833108)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:28.509391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c4ba-eb22-4e4f-974e-40c72c7ab550 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:28.511396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 156/311] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:28 2021] GET /identity/v3/projects/d619747d92dd4ce8a23a9280f1833108 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:28.518479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:28.533123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd886e9-9267-415a-97c8-f3c91e531eac admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:28.543675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badec5e4-9a73-4a11-8eb5-f1fe1c657561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:28.544571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec5e4-9a73-4a11-8eb5-f1fe1c657561 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.544854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec5e4-9a73-4a11-8eb5-f1fe1c657561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.545130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec5e4-9a73-4a11-8eb5-f1fe1c657561 admin admin] PATH_INFO: `/v3/projects/d619747d92dd4ce8a23a9280f1833108/groups/5d4f0ff411084fbd9518fa741b7b480a/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.551988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badec5e4-9a73-4a11-8eb5-f1fe1c657561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d619747d92dd4ce8a23a9280f1833108, group_id=5d4f0ff411084fbd9518fa741b7b480a, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:28.554685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badec5e4-9a73-4a11-8eb5-f1fe1c657561 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:28.613280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 156/312] 10.222.0.73 () {58 vars in 1464 bytes} [Fri Aug 27 03:44:28 2021] PUT /identity/v3/projects/d619747d92dd4ce8a23a9280f1833108/groups/5d4f0ff411084fbd9518fa741b7b480a/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:44:28.834186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6faa6-52fe-4a4c-9a7b-ab90997ec008 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.834186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6faa6-52fe-4a4c-9a7b-ab90997ec008 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.834186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6faa6-52fe-4a4c-9a7b-ab90997ec008 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.834186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 157/313] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:28.841516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:28.841836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:28.842074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:28.867704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:28.869483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:29.055159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 157/314] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:29.108651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6faa6-52fe-4a4c-9a7b-ab90997ec008 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.125413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6faa6-52fe-4a4c-9a7b-ab90997ec008 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.134240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.136091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.136600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.137077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.153946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:29.161208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:29.162748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 158/315] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:29.170055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.183984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff63ee-a284-4011-b349-e552f943d189 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.190966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.191658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.191943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.192222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.192987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:29.193295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.195087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.213856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 158/316] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:29.221796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.238823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d668a8-b423-43e2-b20d-1c7aea7448b4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.246846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.247871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.248369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.248836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.258552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.264580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.275976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 159/317] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:29.283271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.294331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5664c3f-cd06-4e66-83b1-0e8201660196 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.311281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.312164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.312448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.312725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.314001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.316116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.318166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 159/318] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:29.324890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.335981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed82ee-6ddf-486e-b07e-8a36a782892a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.347525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49708f-aac4-4293-a2e7-c2697b4e4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.348405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49708f-aac4-4293-a2e7-c2697b4e4b64 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.348684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49708f-aac4-4293-a2e7-c2697b4e4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.348953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49708f-aac4-4293-a2e7-c2697b4e4b64 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.355711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49708f-aac4-4293-a2e7-c2697b4e4b64 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.359029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49708f-aac4-4293-a2e7-c2697b4e4b64 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.361948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 160/319] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:29.368663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.379504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066de86e-9421-46d2-965a-c1c19ccb252b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.391049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.391727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.392015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.392295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.393152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:29.393467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.395384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b162-ef4b-43db-9876-581f35678030 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.407129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 160/320] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=322777f2a56841baaad99b09485c4a0e => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:29.742361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acb018-5ac6-40fc-80a5-18e95f3098de None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.743071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acb018-5ac6-40fc-80a5-18e95f3098de None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.743071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acb018-5ac6-40fc-80a5-18e95f3098de None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.745493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 161/321] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:29.752519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d69d-dfaa-401b-b829-e1776be04c2e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.752948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d69d-dfaa-401b-b829-e1776be04c2e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.753360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d69d-dfaa-401b-b829-e1776be04c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.776779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bff8d69d-dfaa-401b-b829-e1776be04c2e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:29.778028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bff8d69d-dfaa-401b-b829-e1776be04c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:29.790170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 161/322] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:29.819196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acb018-5ac6-40fc-80a5-18e95f3098de None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.836595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acb018-5ac6-40fc-80a5-18e95f3098de None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.841649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.842472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.842800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.843076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.845415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8ecd-e74f-4b63-954d-ff2e373aad60 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.845704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8ecd-e74f-4b63-954d-ff2e373aad60 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.845983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8ecd-e74f-4b63-954d-ff2e373aad60 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.848170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 162/323] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:29.854774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.855106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.855392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.855671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:29.865274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:29.867589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 162/324] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:29.875303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.878753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:29.880229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:29.886468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c56ee5-96a1-4978-b6f5-6a1ee6c22277 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.894767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 163/325] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:29.897563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.898308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.898630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.898950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.899770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:29.900139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.902172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.915314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 163/326] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:29.917497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.922418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.928177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81473b-9f88-4de5-ad28-91b478384266 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.933406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.934582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.935074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.935547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.936247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31e754-b23b-430d-b3da-f3ca7f2cf0bd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:29.946415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:29.947781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:29.948264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:29.948737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:29.949928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:29.957211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:44:29.962615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:29.962615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:29.963921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 164/327] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:29.967243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.973796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 164/328] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:29.981334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:29.992527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46334aee-f11c-4c93-aa10-3fd75a01f04f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.000176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac223f3d-4e9a-4cad-826d-2cbff551acf2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.006960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.008029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.008583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.009058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.010868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:30.011478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.012273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.013149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.013438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.013716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.014441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.014962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.017006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.018755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 165/329] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:30.026263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.031889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 165/330] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:44:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:30.034055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.045047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8176c-5aaf-42cf-ac1a-0c1f83180ca4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.047476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4add-66a0-4d2f-a85b-3fa68a03e229 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.051936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.052817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.053109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.053376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.053905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.054613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.055074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.055550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.056125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.058041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.061999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 166/331] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:30.067916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.069855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.070541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.083764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb040a-d174-4eb0-b4a1-195056f43ce1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.090011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 166/332] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:30.093943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.099749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.100421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.100707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.100984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.101842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=3953d9945a8c4f53a64136a4286b7dd0) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:30.102145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.104852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.105271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ab0e4-9dd1-40e0-878b-230c1eb88b1b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.112179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 167/333] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=3953d9945a8c4f53a64136a4286b7dd0&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 611 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:30.112989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.115096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.115645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.116134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.118553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.121626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.129623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 167/334] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:30.131464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.143243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a662d-07f5-4707-9f65-2dbab9e4473b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.148665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507219b-fbf6-496b-9672-84df47b98208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.150012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507219b-fbf6-496b-9672-84df47b98208 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.151367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507219b-fbf6-496b-9672-84df47b98208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.151866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507219b-fbf6-496b-9672-84df47b98208 admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.153570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507219b-fbf6-496b-9672-84df47b98208 admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.156011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507219b-fbf6-496b-9672-84df47b98208 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.162727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 168/335] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:30.165882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.177517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5200eb-303b-4d80-b4fa-b4138fd58de2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.188327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.189073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.189357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.189632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.190674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=322777f2a56841baaad99b09485c4a0e, scope.project.id=1312f09679814848855420c41dd2ec09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:30.190990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.193006 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461f10e-73b3-4237-898c-1c7bd9cf7b06 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.210267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 168/336] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=322777f2a56841baaad99b09485c4a0e => generated 611 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:30.529205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41a109-9f0a-4d02-875d-69c0f8a11682 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.529581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41a109-9f0a-4d02-875d-69c0f8a11682 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.529762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41a109-9f0a-4d02-875d-69c0f8a11682 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.531932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 169/337] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:30.538084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.538933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.539367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.559163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:30.560768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:30.570895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 169/338] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:30.595304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41a109-9f0a-4d02-875d-69c0f8a11682 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.609288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41a109-9f0a-4d02-875d-69c0f8a11682 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.613616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.614423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.614859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.615138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.629772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:30.638779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:30.640424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 170/339] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:30.646915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.657442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c56aa-d633-48f8-89e8-9c9a1f6d8046 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.664440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.665131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.665471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.665705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.667004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:30.667113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.668676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.677806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 170/340] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:30.684296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.699232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dc329-f6c0-44d5-b4f3-be0dbcfdd2a9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.706445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.707485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.707970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.708460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.720354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.722128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.732097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 171/341] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:30.738761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.749575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79749aad-fcf4-4522-b82c-8de22dcd9903 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.757835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.758867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.759155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.759951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.761239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.767171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.767171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 171/342] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:30.772150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.782994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71efd5f-1825-4a43-a26e-00f2c2978b47 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.787564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a609f-2f10-415d-80a3-af0c551a7c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.788420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a609f-2f10-415d-80a3-af0c551a7c2f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.788705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a609f-2f10-415d-80a3-af0c551a7c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.788979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a609f-2f10-415d-80a3-af0c551a7c2f admin admin] PATH_INFO: `/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.790218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a609f-2f10-415d-80a3-af0c551a7c2f admin admin] RBAC: Authorizing `identity:get_group(group_id=0df1d59216bf4cddaa5f79dcf19884b1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.793053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a609f-2f10-415d-80a3-af0c551a7c2f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.794812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 172/343] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/groups/0df1d59216bf4cddaa5f79dcf19884b1 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:30.802040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:30.815132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a4b6-66c8-444f-9d27-93c81cfe57ec admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:30.819677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:30.820347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:30.820632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:30.820914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:30.821755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] RBAC: Adding query filter params (group.id=0df1d59216bf4cddaa5f79dcf19884b1, role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=1312f09679814848855420c41dd2ec09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:30.822612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:30.824539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88987c6f-fb3a-4d76-a4d9-ca2b5ae19557 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:30.830705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 172/344] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:30 2021] GET /identity/v3/role_assignments?group.id=0df1d59216bf4cddaa5f79dcf19884b1&scope.project.id=1312f09679814848855420c41dd2ec09&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:31.246389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91de6-b126-49e8-acd0-e1906ed724ad None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.246702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91de6-b126-49e8-acd0-e1906ed724ad None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.246984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91de6-b126-49e8-acd0-e1906ed724ad None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.248763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 173/345] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:31.254854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.255142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.255418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.273655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:31.274902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:31.282733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 173/346] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:31.307976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f91de6-b126-49e8-acd0-e1906ed724ad None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:31.319979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f91de6-b126-49e8-acd0-e1906ed724ad None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:31.324863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:31.325647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.325933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.326210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.336535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:31.343635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:31.344840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 174/347] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:31.351470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:31.361361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289316bb-217b-4a13-b432-416cd0b80d6e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:31.365941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:31.366636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.366921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.367196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.367942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:31.368248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:31.370599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:31.379068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 174/348] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:31.385956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:31.395793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596622-f9ba-4bc5-aea3-14bf68244db4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:31.400752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:31.401488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.401774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.402045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.410931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:31.412664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:31.421992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 175/349] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:31.428412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:31.438907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbda7f-f01c-437e-92ef-0070f88eb45e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:31.443400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:31.444256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.444543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.444821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] PATH_INFO: `/v3/projects/d619747d92dd4ce8a23a9280f1833108` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.445995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] RBAC: Authorizing `identity:get_project(project_id=d619747d92dd4ce8a23a9280f1833108)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:31.448932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:31.450661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 175/350] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:44:31 2021] GET /identity/v3/projects/d619747d92dd4ce8a23a9280f1833108 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:31.456958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:31.466835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b9c6-ef71-4d68-8ba7-12204844c397 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:31.471312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9b8f-7dc5-4e8b-b707-8666a364a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:31.472152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9b8f-7dc5-4e8b-b707-8666a364a3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.472427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9b8f-7dc5-4e8b-b707-8666a364a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.472695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9b8f-7dc5-4e8b-b707-8666a364a3e6 admin admin] PATH_INFO: `/v3/groups/5d4f0ff411084fbd9518fa741b7b480a` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.473864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be9b8f-7dc5-4e8b-b707-8666a364a3e6 admin admin] RBAC: Authorizing `identity:get_group(group_id=5d4f0ff411084fbd9518fa741b7b480a)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:31.475772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be9b8f-7dc5-4e8b-b707-8666a364a3e6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:31.477357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 176/351] 10.222.0.73 () {56 vars in 1202 bytes} [Fri Aug 27 03:44:31 2021] GET /identity/v3/groups/5d4f0ff411084fbd9518fa741b7b480a => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:31.487315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:31.498128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a77911-1019-4178-83b2-bb5f035cb554 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:31.502608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:31.503271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:31.503559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:31.503839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:31.504709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] RBAC: Adding query filter params (group.id=5d4f0ff411084fbd9518fa741b7b480a, role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=d619747d92dd4ce8a23a9280f1833108) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:31.505020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:31.506899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a3ed-96e4-41fc-b125-32d3f0d7d657 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:31.514192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 176/352] 10.222.0.73 () {56 vars in 1398 bytes} [Fri Aug 27 03:44:31 2021] GET /identity/v3/role_assignments?group.id=5d4f0ff411084fbd9518fa741b7b480a&scope.project.id=d619747d92dd4ce8a23a9280f1833108&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:34.206249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a2b-ce8c-407d-977e-668499be9443 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.206840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a2b-ce8c-407d-977e-668499be9443 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.206916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a2b-ce8c-407d-977e-668499be9443 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.208991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 177/353] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:34.215353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.215806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.216004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.239707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:34.240847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:34.249317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 177/354] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:34.287752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1a2b-ce8c-407d-977e-668499be9443 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:34.304642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1a2b-ce8c-407d-977e-668499be9443 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:34.309772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:34.310585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.310881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.311156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.330668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:34.332873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:34.357860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:34.359515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 178/355] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:34.366058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:34.388513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8dc1-2706-44e6-bc3b-05caf2492c22 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:34.414609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:34.414609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.414609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.414609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.415007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:34.415007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:34.415007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfab58-0072-4628-af3a-ad4caa063646 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:34.443218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 178/356] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:34.449779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:34.472973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d452ae-9ec6-43ad-8d96-7d5a0210aa77 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:34.499363 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce97b96-ea82-43d3-9497-d52b3626a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:34.500404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97b96-ea82-43d3-9497-d52b3626a5df admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.500886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97b96-ea82-43d3-9497-d52b3626a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.501358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce97b96-ea82-43d3-9497-d52b3626a5df admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.502307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce97b96-ea82-43d3-9497-d52b3626a5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:34.504505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce97b96-ea82-43d3-9497-d52b3626a5df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:34.617399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 179/357] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:34 2021] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:34.766373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18246d-46d8-4c39-bda5-90ad2fd6fcea None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.766730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18246d-46d8-4c39-bda5-90ad2fd6fcea None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.766921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18246d-46d8-4c39-bda5-90ad2fd6fcea None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.768955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 179/358] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:34.782180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47227453-228b-4b87-bfb5-25c64cff134e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.782665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47227453-228b-4b87-bfb5-25c64cff134e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.783117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47227453-228b-4b87-bfb5-25c64cff134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.818461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-47227453-228b-4b87-bfb5-25c64cff134e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:34.819683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-47227453-228b-4b87-bfb5-25c64cff134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:34.832734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 180/359] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:34.932379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18246d-46d8-4c39-bda5-90ad2fd6fcea None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:34.949539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9ea-2768-4c29-8adb-62ce513ae16b None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.949858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9ea-2768-4c29-8adb-62ce513ae16b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.950099 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9ea-2768-4c29-8adb-62ce513ae16b None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.950198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18246d-46d8-4c39-bda5-90ad2fd6fcea None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:34.952150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 181/360] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:34.955829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:34.956892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.957469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.957941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.958862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.959171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.959432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.980231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:34.982100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:34.986867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:34.988080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:35.002399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:35.004520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 182/362] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:35.008360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 180/362] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:35.015654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.026178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365373e-0274-4c69-aff3-bcf64d428cf9 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.030798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.036831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.037804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.038328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.038810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.039734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:35.040293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.044448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a004-7c42-4c1c-bd52-f1312114a033 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.044585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:35.044585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:35.044585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:35.044585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.053157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.053971 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.054261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.054535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.066708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.073370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.073806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 183/363] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:35.075391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.088057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:35.089727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 181/364] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:35.090171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd3cd-c71b-47da-9452-88ef26e11c85 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.096470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.097076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33db0-8c56-4dd2-aac8-aa5b90298ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.099347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33db0-8c56-4dd2-aac8-aa5b90298ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.099347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33db0-8c56-4dd2-aac8-aa5b90298ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.099347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33db0-8c56-4dd2-aac8-aa5b90298ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.099347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a33db0-8c56-4dd2-aac8-aa5b90298ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.101061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a33db0-8c56-4dd2-aac8-aa5b90298ee0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.108087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087722-6c3e-4560-9b82-3556aaf1862f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.114283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.115120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.115543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.115832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.116630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:35.116999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.118831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.132843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 182/365] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:35.139493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.150028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7936c3-e34a-4cc8-bb84-edc2769ac92b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.155162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9076b6-57e4-4bfd-bed1-79d21968b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.155955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9076b6-57e4-4bfd-bed1-79d21968b233 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.156243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9076b6-57e4-4bfd-bed1-79d21968b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.156539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9076b6-57e4-4bfd-bed1-79d21968b233 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.157286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9076b6-57e4-4bfd-bed1-79d21968b233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.159405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9076b6-57e4-4bfd-bed1-79d21968b233 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.220194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 184/366] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:35 2021] POST /identity/v3/users => generated 248 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:44:35.257690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 183/367] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:35 2021] POST /identity/v3/users => generated 248 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:44:35.582732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912973-8aba-4e57-af2b-8214cd4f4244 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.583123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912973-8aba-4e57-af2b-8214cd4f4244 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.583345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912973-8aba-4e57-af2b-8214cd4f4244 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.585439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 185/368] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:35.592022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.592315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.592583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.617012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:35.618202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:35.628199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 184/369] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:35.654968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912973-8aba-4e57-af2b-8214cd4f4244 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.672727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912973-8aba-4e57-af2b-8214cd4f4244 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.685732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.686956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.687442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.687918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.711834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.714741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.741352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:35.743066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 186/370] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:35.750189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.760514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a177a6-20d5-41e3-b11f-54e65b3e4bf8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.779547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.780288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.780574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.780852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.781626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:35.781933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.783690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac75b02-855a-42b4-ab58-cbd261032b2e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.803777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 185/371] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:35.810828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.826144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecfbe3-2b45-44fb-a172-05e8d69a7466 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.834591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.835590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.836069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.836540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.838107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.840389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:35.843892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1e9b-6d3c-4693-9aff-689ead89cd07 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.844422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1e9b-6d3c-4693-9aff-689ead89cd07 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.844916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1e9b-6d3c-4693-9aff-689ead89cd07 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.846947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 186/372] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:35.854288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.854885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.855357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.876840 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:35.878388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:35.887485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 187/373] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:35.911588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:35.921550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2c528-46ae-4b01-840a-1298512cb2c0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:35.926239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:35.926939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:35.927272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:35.927548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:35.928361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:35.929972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:36.010619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.sql.core [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 03:44:36.010619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 03:44:36.010619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [parameters: {'id': '6fc3d0af8bc545b49996fb24f2035a51', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 03:44:36.010619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73793) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 03:44:36.023152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 03:44:36.030683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 188/374] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 03:44:35 2021] POST /identity/v3/roles => generated 144 bytes in 114 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:36.032863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:36.046804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07ef3-cc43-4325-9e8d-02fa299f80ae admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:36.051595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055a78-d707-4a9a-b0b4-4f0d7310f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:36.052455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055a78-d707-4a9a-b0b4-4f0d7310f7ed admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:36.052739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055a78-d707-4a9a-b0b4-4f0d7310f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:36.053015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055a78-d707-4a9a-b0b4-4f0d7310f7ed admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:36.066687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055a78-d707-4a9a-b0b4-4f0d7310f7ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:36.076216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 187/375] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:35 2021] POST /identity/v3/users => generated 249 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:44:36.076399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-f4055a78-d707-4a9a-b0b4-4f0d7310f7ed admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:44:36.082892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 189/376] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:44:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:36.093008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:36.096957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e23ddb-830e-4196-9d5a-d25f132fe090 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:36.102048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:36.104467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:36.104968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:36.105448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:36.106406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:36.106946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:36.108795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef5b6-2293-40f8-855c-8164de5ba9bb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:36.126767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 188/377] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:37.513034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81f570-3233-4bff-bd3f-da87e417591c None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.513757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81f570-3233-4bff-bd3f-da87e417591c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.513757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81f570-3233-4bff-bd3f-da87e417591c None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.515401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 190/378] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:37.529587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.530137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.530215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.554280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:37.555531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:37.569708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 189/379] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:37.606678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81f570-3233-4bff-bd3f-da87e417591c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:37.624898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81f570-3233-4bff-bd3f-da87e417591c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:37.633201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:37.634010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.634879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.635302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.655636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:37.663335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:37.664797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 191/380] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:37.671898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:37.688554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef63b-f8db-4b0e-967b-a4bc1dcb2d1d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:37.695885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:37.697396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.697697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.697973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.698756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:37.699060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:37.700672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:37.717127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 190/381] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:37.722863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:37.739408 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ba44-cb6a-4228-b7af-54d085b93980 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:37.745186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:37.746235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.746747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.747283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.761890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:37.764321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:37.794407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:37.796040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 192/382] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:37.802227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:37.826073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820cf58-32fe-4b3b-a169-1b1d5e17a0b0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:37.839501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:37.840215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.840485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.840763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.841514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:37.841821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:37.843576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:37.870102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 191/383] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:37.875891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:37.890049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601ea1-00ad-4fd6-a5ee-857fc70fce47 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:37.899349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:37.901139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.901626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.902166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.913907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:37.920560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:37.940733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-e51d1632-35a8-43e8-8d6c-fa72c9eca30b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:44:37.942309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 193/384] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:44:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:37.949463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:37.964659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dee098-f01e-45c6-b48d-ddf128164144 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:37.976622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:37.976939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:37.977214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:37.977492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:37.978968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:37.979343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:37.980694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:37.980694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:37.980694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:37.981873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.010493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad9ba1-a30d-47de-81a3-f070f8afd2b3 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.010833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad9ba1-a30d-47de-81a3-f070f8afd2b3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.011067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad9ba1-a30d-47de-81a3-f070f8afd2b3 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.013138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 194/385] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:38.020592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.020871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.021052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.029107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 192/386] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:44:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.034945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.045130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2be4a-1612-427e-b871-b28d5c108027 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.050205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.051370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.051370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.051704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.062510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.063621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:38.064388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.064871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:38.075666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 193/387] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:38.081889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.091712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161685d7-315e-414f-b9c7-ab37f3ef3a7f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.093226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 195/388] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:38.105689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.106502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.106849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.107127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.120290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.126706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.128928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.132533 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9896-4070-4215-aaf0-648e1515174c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.147988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.148820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.149102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.149377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.151932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:38.153791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 194/389] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:38.160402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.171887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a952f8f-f8e7-400b-8115-9c0b5b6bb7b1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.177151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.178136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.178586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.179049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.179939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.180469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.182426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.183855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:38.198593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:38.198593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 196/390] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:38.198895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 195/391] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:38.204660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.210459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.220871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a8fcb-2b79-4ff5-bacc-61a25c432f01 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.227317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6c76-ff28-4a06-bdbc-fec1e8394833 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.231561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.232372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.232660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.232941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.242036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.242743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.242858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.243070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.244082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.245120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.245304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.245473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.247191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c828-cf22-40f5-a885-e0942b8df964 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.255972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 196/392] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.257348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d49223-3caa-43f0-a034-687b34260538 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.257640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d49223-3caa-43f0-a034-687b34260538 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.257920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d49223-3caa-43f0-a034-687b34260538 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.260006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 197/393] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:38.260804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-2faf09ca-a85e-4fdc-8b2b-fb2312006a5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:38.266621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d49223-3caa-43f0-a034-687b34260538 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.267107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 197/394] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:38.268679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.269145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.269630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.279049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d49223-3caa-43f0-a034-687b34260538 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.283443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.284237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.284567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.284842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.292714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:38.294173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:38.302893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 198/395] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:38.304032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.323987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cb2f-9629-4099-a38a-075680619d61 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.329592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.330413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.331029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.331395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.332241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.332582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.333605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:38.333605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:38.333605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:38.334815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.361712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 199/396] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.362853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.375120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5873f-eac8-45fa-81c9-9f73bbcef5c4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.380770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.381601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.381884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.382162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.395966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:38.403849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:38.405503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 200/397] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:38.406336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.418041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c485-4cdf-4073-a8bf-3f5dc731ff23 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.422779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.423457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.423788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.424065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.424973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=bb32cee436d24774b51fa67a73ef342d) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.425287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.427300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.433708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.434534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 201/398] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/role_assignments?user.id=bb32cee436d24774b51fa67a73ef342d&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.435931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.439445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.470449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dd091-f8f3-4588-a793-ef0e2bb18339 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.474437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:38.477459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 198/399] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:38.482599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.483459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.483878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.484247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.485183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.485589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.487440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.487617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.498499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 202/400] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.505907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.509774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580ae4-4a85-4c2b-b389-102ce8e6ca71 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.517646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922fc5-946b-46c8-99c5-8fc43acabd02 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.524987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.527485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.528417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.528706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.530123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.530939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.535165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.536968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.537468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.538042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.539219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.566883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 199/401] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.567251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.569257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.593213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.603739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111b71-6843-44a0-8241-0527f8fec50e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.607643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:38.608913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 203/402] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:38.616396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.625900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.626746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.627029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.627306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.637160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b3c11-8a65-4cf5-a3c1-8135d531b1e6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.644894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.645208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.646109 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.646540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.647106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.648357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.648863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.649257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.652272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.676090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 204/403] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:38.680332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:44:38.683453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 200/404] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/users/cinder => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:38.690575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.698923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.712032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdbcd-e42f-4a18-a9bf-f253f9e8d652 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.720703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce825-d816-406e-ac59-b430ac1c0fe5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.723994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.724812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.725318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.725595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.731824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.732555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.732831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.733487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.735758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.736071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.740355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.744489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.746657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.776374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 03:44:38.778689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 201/405] 10.222.0.73 () {56 vars in 1159 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:38.788151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.788515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 205/406] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/users/glance => generated 84 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:38.801355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554e3e-62e9-485f-9f5f-848a7dc333d3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.804878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.816326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813481-d039-4115-9222-5b3951898a31 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.819734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.820628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.821427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.821807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.829317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.830036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.830320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.831571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.831571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.832952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.832952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:38.832952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:38.832952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:38.834985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.842336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.842336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.855733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 202/407] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:38.864022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.882279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 206/408] 10.222.0.73 () {56 vars in 1159 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:38.889330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.890532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b181-228c-4647-9152-b99e87018921 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.900942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4713f46-fabd-41a5-b5e3-cf8e1c54c261 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.903435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.905564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.906414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.906724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.910002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.910703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.912010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.913002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.929464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.930622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.934181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.936310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.954165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 207/409] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:38.960748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:38.962907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 203/410] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:38.967849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.969171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.985445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479287b-c1ba-43b6-a0ab-5d4414197002 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.985779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7823-ec99-4e84-b2e7-8df1ad9bf149 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.990973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.991819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.992109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.998501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.999426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:38.999743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.000063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.000924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.001207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.001487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.001584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.016696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 204/411] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:39.019429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.021337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.022773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.045617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6af7-bba3-4416-a3de-083b08e859f0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.055240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.057621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.057904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.058182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.063485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-23405f6a-dd4e-40d9-852a-713b12b11dc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:39.067400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 208/412] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.072772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d42d-5777-41d5-987b-86cfa36a57be None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.073074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d42d-5777-41d5-987b-86cfa36a57be None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.073328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d42d-5777-41d5-987b-86cfa36a57be None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.076576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 209/413] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:39.076809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.077008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d42d-5777-41d5-987b-86cfa36a57be None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.078747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.092608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d42d-5777-41d5-987b-86cfa36a57be None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.098011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.098726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.099069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.099395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.100198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.100507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.101444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-a45c5cc9-e2b9-4897-b221-da532a65d328 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:39.102259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.104836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 205/414] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:39.106505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.107038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.107504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.123285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 210/415] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.129468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.131772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:39.132970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:39.142109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 206/416] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:39.142982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.145609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecac4f-9ce1-4f6b-b8f1-7a54d424fb56 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.151428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.152482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.152974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.153387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a343d-6224-4ac6-8a46-60151cc59ed2 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.153663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.154996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.155499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.157764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.158084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.158972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.159257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.159583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.168764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.170905 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.173765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 211/417] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.180709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.190120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-7e92ca59-66b7-40f9-a9a5-fe14d5d613f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:39.191092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bab5c-f874-43a0-9e60-6c3bd3edde04 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.191566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 207/418] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.192711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507e2f-7039-46a0-8b52-340ab8e1258b None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.193000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507e2f-7039-46a0-8b52-340ab8e1258b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.193275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507e2f-7039-46a0-8b52-340ab8e1258b None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.196079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 208/419] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:39.196079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507e2f-7039-46a0-8b52-340ab8e1258b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.201675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.202489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.202799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.203068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.213648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.215579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507e2f-7039-46a0-8b52-340ab8e1258b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.215710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.221056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.221770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.222097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.222426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.223796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=65d84bc451c5469b89788e179bfc4189) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.224108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.226733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.233394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 209/420] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/role_assignments?user.id=65d84bc451c5469b89788e179bfc4189&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.234811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-40f46db1-2c85-44c6-a317-acc6ca8198bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:39.234922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.235139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 212/421] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.240991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.240991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.240991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.244787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7b7df-9962-4c73-873a-3ae638449030 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.249616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.250658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.250997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.251272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.253116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.253441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.254505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:39.254505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:39.254505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:39.255720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.267335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:39.268975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:39.283678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 210/422] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.283678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.283945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 213/423] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:39.285519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.305964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c42f7-a804-476d-9886-5eace131b2ac admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.309245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621cd1-5bee-4c67-9723-3e91ce96907b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.312759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.313841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.314321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.314491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.315095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.315267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.315539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.315870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.316589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.316775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=4f148f069b014ed5baa06b408bab5d1e) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.317075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.317598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.319286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.319768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.327055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 214/424] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/role_assignments?user.id=4f148f069b014ed5baa06b408bab5d1e&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.327797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.340261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e231-1432-4da3-ae72-5d012f901c8e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.340675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 211/425] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.344349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.345776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.346485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.346803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.347082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.357619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e4884-f636-41e2-9211-c35206eeedb3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.361409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:39.363468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.364492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.364984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.365520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.366490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.369233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:39.370187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.370647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 215/426] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.377304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.390249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba6119-32b1-4634-ac37-df2289cbc425 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.395225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.395915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.396196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.396469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.397285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.398136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.399584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.411459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 216/427] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:39.419085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.430270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a0265-fda9-4b63-9289-76f8521bb61d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.436168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.437060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.437348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.437662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.452027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.453968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.475105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 212/428] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:39 2021] POST /identity/v3/users => generated 247 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:39.479993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:39.481484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 217/429] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.488192 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.499916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63346e-63f9-44b6-a0ae-03c86329ffc4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.506027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.506821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.507112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.507450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.508295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.508604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.510700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.526308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 213/430] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.532973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.544831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e12cd-dc38-4874-8141-5b69db2dcbc0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.549789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.550755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.551110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.551456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.564711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.566868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.583535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 03:44:39.585244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 218/431] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:39.592834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.604261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec81147-5b48-42d1-9bae-3cc84ec360a7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.609339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.610130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.610483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.610864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.611798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.612186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.614159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.636959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 214/432] 10.222.0.73 () {56 vars in 1161 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.643626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.654219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e225fd1-e2e4-44f4-8c3c-68e41e4fda69 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.659259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.660084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.660446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.660791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.670871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.673914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.689888 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 219/433] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:39.697884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.710700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc942e-944a-4f23-81f1-6220811aefd9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.715906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.716810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.717165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.717534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.729671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.731662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.750130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:39.751820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 215/434] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.757972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.768835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906817-de63-42bc-bffb-2a5de795ee57 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.774084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.775587 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.776036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.776372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.777193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.777604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.779298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.792572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 220/435] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.799427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.811453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83d8ee-1939-4b64-abc2-ccf34c60009e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.818000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.818847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.819203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.819549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.830209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.832812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.856899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:39.858611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 216/436] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:39.868116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.882505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59098c06-2db7-47bf-ac29-ba0a5aa49dc9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.888136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.888796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.889124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.889428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.890266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.890600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.892867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853df169-2f89-4305-b6e1-df033d476d2f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.909559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 221/437] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:39.916803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:39.927924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a084-2d94-4a99-851e-f81d892145ae admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:39.934099 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:39.934803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:39.935132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:39.935408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:39.936551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=40245bfc762a492587d3e4d39abea6b2) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:39.936855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:39.939098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6184eb1-2fe4-49be-b584-e3f53e0997a8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:39.949584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 217/438] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:39 2021] GET /identity/v3/role_assignments?user.id=40245bfc762a492587d3e4d39abea6b2&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:41.310943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead87d-ba6a-47c9-bad3-c870f29e1e39 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.310943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead87d-ba6a-47c9-bad3-c870f29e1e39 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.310943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead87d-ba6a-47c9-bad3-c870f29e1e39 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.310943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 222/439] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:41.319945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.319945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.319945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.347757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:41.349355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:41.357880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 218/440] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:41.380726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead87d-ba6a-47c9-bad3-c870f29e1e39 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.401034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead87d-ba6a-47c9-bad3-c870f29e1e39 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.406074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.407154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.407641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.408112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.425940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:41.434191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:41.436161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 223/441] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:41.442376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.457524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cc15e-fdf4-4980-a814-64fea0f087b6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.466553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.467256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.467536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.467807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.468561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:41.468864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.470466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.483845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 219/442] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:41.489964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.503938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae0d7-444c-4916-ac31-3ade3230f9d0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.515802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.517004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.517497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.517976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.543241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.545517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.570284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:41.572305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 224/443] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:41.578226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.592762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa40d9b-2a50-4342-9609-7878314d91c9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.606310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.607034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.607317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.607590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.608315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:41.608616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.610210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.630016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 220/444] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:41.636554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.648004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0befe-d5b3-4faa-949e-d8e31ba57414 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.660277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.661079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.661363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.661635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.675749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.677818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.698288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:44:41.699834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 225/445] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:41.706083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.720377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d2cd-b9df-40ca-8f0a-be145bde3c1d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.730284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.731349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.731840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.732378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.733458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:41.734006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.736284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.766107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 221/446] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:41.772170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.784297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9d5c-8547-42dc-a35d-044737a305a8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.799287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.800108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.800385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.800650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.813125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.823390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.843330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:41.844889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 226/447] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:41.851074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.866204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d0c42-603f-42c2-80f5-ce9b16b54e9c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.875968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.877047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.877535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.878012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.879036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:41.879548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.881450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.900799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 222/448] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:41.906928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:41.917728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350526d1-33e6-4e61-9dff-c5c533050b9a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:41.932248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:41.933089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:41.933340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:41.933615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:41.945912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:41.948855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:41.974527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:41.975791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 227/449] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:41.985349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.006960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575ac32-967b-404a-af14-deca835e3553 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.017704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.018865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.019353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.019832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.020884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.021411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.023595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0995-c528-465d-b5c7-a0bae228ef26 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.052341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 223/450] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.058680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.077255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239864-e8f8-4ba2-92a5-9f35860ab55d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.081909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd723-56a1-48eb-813f-bde7d412883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.082854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd723-56a1-48eb-813f-bde7d412883e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.083133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd723-56a1-48eb-813f-bde7d412883e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.083405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd723-56a1-48eb-813f-bde7d412883e admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/bb32cee436d24774b51fa67a73ef342d/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.116958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd723-56a1-48eb-813f-bde7d412883e admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=bb32cee436d24774b51fa67a73ef342d, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.120401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd723-56a1-48eb-813f-bde7d412883e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.196975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 228/451] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:42 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/bb32cee436d24774b51fa67a73ef342d/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:42.272279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e52c7-f127-46fd-b56f-d76a393248c4 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.272610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e52c7-f127-46fd-b56f-d76a393248c4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.272848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e52c7-f127-46fd-b56f-d76a393248c4 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.275656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 224/452] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:42.281736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360294b-79f6-4029-86f9-cd1ab1ec10d1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.282023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360294b-79f6-4029-86f9-cd1ab1ec10d1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.282350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360294b-79f6-4029-86f9-cd1ab1ec10d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.307357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8360294b-79f6-4029-86f9-cd1ab1ec10d1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:42.308561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8360294b-79f6-4029-86f9-cd1ab1ec10d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:42.388334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 229/453] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:42.420956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e52c7-f127-46fd-b56f-d76a393248c4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.445054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e52c7-f127-46fd-b56f-d76a393248c4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.455029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.455848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.456130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.456406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.467251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0257-a98f-49d6-9491-13156c004f92 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.467564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0257-a98f-49d6-9491-13156c004f92 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.467800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0257-a98f-49d6-9491-13156c004f92 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.470619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 230/454] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:42.476598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:42.478527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.478940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.479337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.484506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:42.486338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 225/455] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.494944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.512123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f68749-ef70-4974-8362-10521ea479bb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.514012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:42.515547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:42.523179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.523783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 231/456] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:42.524938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.525624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.526337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.527947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.528670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.531747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.542880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 226/457] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:42.549072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.554808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.561184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b96e47-b9f2-4454-a2a4-a89e1f07ae59 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.568019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f7dfa-0460-4fa1-80f7-a82f33eae006 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.570705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.572268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.572560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.572831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.574777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b43a-e7a1-4122-b365-3f48f2c7892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.575998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b43a-e7a1-4122-b365-3f48f2c7892d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.576445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b43a-e7a1-4122-b365-3f48f2c7892d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.576931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b43a-e7a1-4122-b365-3f48f2c7892d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.593035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.593241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b43a-e7a1-4122-b365-3f48f2c7892d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:42.594990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.600329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-d468b43a-e7a1-4122-b365-3f48f2c7892d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:42.601921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 227/458] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:42.603639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bcb1a-26df-42de-867d-308fe0d958a5 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.604018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bcb1a-26df-42de-867d-308fe0d958a5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.604300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bcb1a-26df-42de-867d-308fe0d958a5 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.606369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 228/459] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:42.612275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.612591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.612933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.615968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:42.617768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 232/460] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.625472 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.633340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:42.635372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:42.644121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 229/461] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:42.644487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5a7d-63ae-46dd-accc-4f2cd1d277fc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.650376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.658905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.659146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71913206-19f8-4d6f-8a11-1f1c0ccca46b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.659761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.660110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.660447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.661272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.661704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.663480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da833e9-230a-4ac0-8482-ad463d7be58f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.664461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.666172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.666916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.667352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.668374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.668786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.670640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47ef0a-9b60-48b0-966f-3c817951a392 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.673951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 233/462] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.675547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0290-23b8-4c42-ba7d-39f7482b6f71 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.675833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0290-23b8-4c42-ba7d-39f7482b6f71 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.676153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c0290-23b8-4c42-ba7d-39f7482b6f71 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.678244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 234/463] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:42.682720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c0290-23b8-4c42-ba7d-39f7482b6f71 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.690403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 230/464] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.691972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.692814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.693109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.697663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c0290-23b8-4c42-ba7d-39f7482b6f71 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.703340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.704151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.704438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.704766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.711795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:42.713230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:42.716262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:42.720949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 231/465] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:42.725374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.726790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:42.728806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 235/466] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.735611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba63920-ebb9-4b4a-a3f1-2ce96267bd55 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.735882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.740732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.741873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.742335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.742997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.748665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cae63-4423-453a-aa29-ad74fdc3f0b4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.754967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.755772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.756056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.756333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.756520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.758475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.765448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.767523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.777027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:42.783198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 232/467] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.783198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.783429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:44:42.783429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 236/468] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.783577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.794073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70d15-d489-4431-80c7-ded123facd33 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.797277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250b4d-7915-4725-a2fb-e21aa27a7d77 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.800310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.801105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.801485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.801855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.802036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.802824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.802920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.803125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.803383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.803475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.805152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.815323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 233/469] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.815928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.820781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:42.827632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c3691-5671-4e26-b614-468f6f6b8c6d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.828731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:42.830209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 237/470] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.830897 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.837942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.839222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.839731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.840241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.841639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.842161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.842656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f21fd1-4375-4d6c-8fb0-d590f2503384 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.844181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.848826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.849569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.849965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.850307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.851135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.851594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.853955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.867289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 234/471] 10.222.0.73 () {56 vars in 1159 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.869325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.869805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 238/472] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.870785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.880036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1834ca5-aa3b-46a5-9ca9-6ae1dee22e5a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.885311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.886226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.886409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.886718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.893375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa055-62ed-44e0-af47-11617b1a1351 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.898176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.898298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.899075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.899465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.900370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.900652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.901411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:42.901789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.903496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.912097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 239/473] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:42.913007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.923204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3168-648e-4197-a80f-9df1c6e24530 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.926223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:42.933432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 235/474] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.933620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.933730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.933823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.933823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.933823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.945071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a5b2-6ae2-4c87-92d8-b8afc2d0f76d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.947795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.949770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.950939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.951836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.952222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.952599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:42.960286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:42.966528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:42.968560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:42.975021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 240/475] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.975021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.984072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 03:44:42.984292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855559d4-14f2-4ed4-9c0f-6490fbcf20a9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:42.985493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 236/476] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:42.986352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:42.988905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:42.989701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:42.989984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:42.990261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.002317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176bcc5-8f53-4cef-89ec-4c367100e50e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.006145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.006972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.007632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.007917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.008124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.008220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.009487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.010537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.011450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.027694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 237/477] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.027694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.027981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:43.030376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 241/478] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.030376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.041252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9e38a-69a2-4834-bf4d-da6edd4ae733 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.044592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e7c10-5303-417e-8d82-995d26e0d1d6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.046306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.047107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.047494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.047875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.048706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.049050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.049215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.049713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.049993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.050266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.051127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.051262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.051435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.053299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.071167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 238/479] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.071167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.073231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 242/480] 10.222.0.73 () {56 vars in 1159 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.075907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.083633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c199fd-e4e5-4fae-bed2-5885e2ee6d2e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.086142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac81092-1786-4a77-aa68-2d0be37e9d0f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.088885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.089689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.089971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.090245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.091827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.092629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.092918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.093580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.094016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.094328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.096134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.098880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.100922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.116909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 243/481] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.116909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.117154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 03:44:43.117876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 239/482] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.120242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.123096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10add2-67af-4ecf-8641-e9512509ec93 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.127828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.128636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.128920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.129205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.133428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13df261-9c44-4195-8d99-09dc322eeefe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.137646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.138767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.139679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.139850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.140148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.140538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.152840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.154817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.155000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:43.161394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 244/483] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.161394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.171774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c1e8-49ea-4d63-bead-a5178f65743b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.176295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.177184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.177591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.177967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.179672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:43.181533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 240/484] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.182050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.191172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.192316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb7265-dac2-4d7b-b9f5-81a911392406 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.193540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.197025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.197705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.197986 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.198264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.199134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.199446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.201303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.208435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:44:43.209656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 245/485] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.210421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.221694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dcbc8-78cb-4475-83b0-f190b4e09a51 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.225690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 241/486] 10.222.0.73 () {56 vars in 1161 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.226398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.233126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.234177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.235283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.235739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.237412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.237918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.240676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56f5e-ce70-4bbf-9d3b-20597cff63f8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.241312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.247480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.248537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.248985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.249443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.250714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.251228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.253785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.261990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 246/487] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.263300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.274997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 242/488] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.274997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.282547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0ff6-04cc-4c75-aef7-70e812dcfc72 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.283329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6318e0-70dd-4626-8dfa-c7eda7a0d250 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.289258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.289433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.290141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.290910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.291012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.291205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.291696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.292061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.293095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.293496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.295496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.305957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.307174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.317056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 247/489] 10.222.0.73 () {56 vars in 1157 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.318052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.324704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:43.325642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 243/490] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.326288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.329828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0bb61-edcd-4f80-853a-77afe8c77c0a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.334920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.335805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.336086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.336359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/65d84bc451c5469b89788e179bfc4189/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.342180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87b7f-8997-454a-a89f-ad06a2f3e971 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.346812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.347794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.348219 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.348644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.354891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=65d84bc451c5469b89788e179bfc4189, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.356953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.357555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.359285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.373413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:43.374636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 244/491] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.377760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.389485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f3b9-f1bc-4407-a0fd-41251a1e1b71 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.394280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.394952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.401593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.401593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.404671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.406388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.416932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 245/492] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:43.418160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.419620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 248/493] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:43 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/65d84bc451c5469b89788e179bfc4189/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:43.420595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.433783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022f28-4983-4192-ab13-84594f35411c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.503933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.504622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.504962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.505246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.505998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.506309 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.508061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.521637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 246/494] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.521855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a56e1-4518-49a6-90ea-b8e68edde4d8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.523518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.532575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.533924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.534215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.534681 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.535706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.536026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.537333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5847e-5e44-46a4-b0a6-4a689fd46397 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.537942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.544370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.545667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.546304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.547045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.554164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 249/495] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.554841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.569992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf6b5-86be-46c6-8fce-7f68fd10ceb6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.571052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.573877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.576783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.578361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.578867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.579248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.589570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.591899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.592947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:43.594522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 247/496] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.595635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.610155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c61c7-9e4b-45ad-b003-644bc23ac220 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.614714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.615686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.615965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.616302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/4f148f069b014ed5baa06b408bab5d1e/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.618266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:43.621282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 250/497] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.621594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.637635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=4f148f069b014ed5baa06b408bab5d1e, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.640648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.641216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692df4cf-d1b9-4edd-9d32-7a49406461eb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.647008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.647693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.647974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.648344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.648987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.649294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.651154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.664223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 251/498] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.665618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.677651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d329c7-30f3-4660-947c-ae897a7b710b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.682674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.683475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.683835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.684184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.685053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.685583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.687623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.701985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 252/499] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.713631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.719576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048222-2056-4b5d-a324-397bcef1154b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.724139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.725025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.725389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.725728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.734481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.736558 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.750874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:43.752311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 253/500] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:43.758282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.758448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 248/501] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:43 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/4f148f069b014ed5baa06b408bab5d1e/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:43.763681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.776591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd633-7982-482e-be03-cd1a865c054b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.845034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac1a8a-3f51-4af3-b74f-f8f7d7636567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.846354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac1a8a-3f51-4af3-b74f-f8f7d7636567 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.846806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac1a8a-3f51-4af3-b74f-f8f7d7636567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.847257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac1a8a-3f51-4af3-b74f-f8f7d7636567 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/40245bfc762a492587d3e4d39abea6b2/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.865074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac1a8a-3f51-4af3-b74f-f8f7d7636567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=40245bfc762a492587d3e4d39abea6b2, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.868659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac1a8a-3f51-4af3-b74f-f8f7d7636567 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.892202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdae915-c691-4f43-9043-8fa925b865f1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.898524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.900369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.900838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.901262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.902474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.902985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.905521 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.924342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 249/502] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:43.934593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:43.948832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a768c8-4456-41eb-be67-df0ca7297783 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:43.955187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:43.956254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:43.956687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:43.957142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:43.958196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8946263bd74d445f81944be54ef96070) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:43.958723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:43.970361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 254/503] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:43 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/40245bfc762a492587d3e4d39abea6b2/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:43.971782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793e8b-a617-481d-87e3-bc7903c650b3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:43.990540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 250/504] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:43 2021] GET /identity/v3/role_assignments?user.id=8946263bd74d445f81944be54ef96070&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:44.701459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33631b71-2376-4e7e-983c-2d5db342c556 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:44.702796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33631b71-2376-4e7e-983c-2d5db342c556 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:44.703163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33631b71-2376-4e7e-983c-2d5db342c556 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:44.706763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 255/505] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:44 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:44.714169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:44.714793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:44.715211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:44.740424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:44.742000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:44.816450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 251/506] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:44.855238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33631b71-2376-4e7e-983c-2d5db342c556 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:44.869138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33631b71-2376-4e7e-983c-2d5db342c556 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:44.874087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:44.875065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:44.875458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:44.875836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:44.888485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:44.895692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:44.897468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 256/507] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:44.904852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:44.914262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204aa7-8276-4020-bc1b-602a5b17b3bd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:44.920528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:44.921408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:44.921797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:44.922235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:44.926003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:44.926493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:44.928254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:44.939829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 252/508] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:44.945865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:44.960853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d796fe-7826-45ef-b868-71b97fca2479 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:44.966243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:44.967287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:44.967678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:44.968062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:44.985424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:44.987341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.018708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:45.020519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 257/509] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:45.027480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.044072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323abfb-d710-4d05-8893-e896b24d51e7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.052997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.053861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.054251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.054669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.055602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:45.056158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.058319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.082682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 253/510] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:45.084675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.106804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cadb0b-c0fa-4851-ad71-5f042b512f66 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.120415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.121456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.121883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.122409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.139794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.142067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.161967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:44:45.163434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 258/511] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:45.170072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.184434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25190d-bc32-4aa2-8eed-500411ae7e90 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.203394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.204094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.204378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.204659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.205514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:45.205824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.207690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.234748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 254/512] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:45.238945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.261196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc2a29-cdd3-47cf-9726-fe485edb91a0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.276538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.277437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.277867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.278309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.294909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.296928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.312314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 259/513] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:45.319000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.344973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a642ef-2e1e-4503-9642-53d76aecc15c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.350053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.350940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.351271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.351551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.363927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.365766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.384304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:45.385886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 255/514] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:45.391937 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.408430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9429ec-c38c-40d9-be30-9fbc041dc94d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.417465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.418215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.418501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.418799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.419551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:45.419853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.421490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.439648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 260/515] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:45.445821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.464474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac167d3-a64a-41d1-b25b-5b0f97dd4951 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.474984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.475970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.476359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.476733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.489948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.492046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.516167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:45.518817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 256/516] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:45.525658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.545735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adde9b5-0814-46bc-a5f1-123a057a6397 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.559354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.560042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.560378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.560660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.561521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:45.561934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.563963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159855-8e23-46c6-9c82-317094ef8eb9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.585359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 261/517] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:45.592498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:45.615922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107d498-589c-45af-8661-f78faba53523 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:45.626374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:45.627211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:45.627592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:45.627969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:45.628911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=bb32cee436d24774b51fa67a73ef342d) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:45.629325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:45.631335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8327c7-765f-4ab1-848a-f884f22ad196 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:45.643802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 257/518] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:45 2021] GET /identity/v3/role_assignments?user.id=bb32cee436d24774b51fa67a73ef342d&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.188240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322c0c-c2ad-46fc-b44c-ab1cce87e8ab None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.188754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322c0c-c2ad-46fc-b44c-ab1cce87e8ab None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.188828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322c0c-c2ad-46fc-b44c-ab1cce87e8ab None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.190884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 262/519] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:46.197203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.197775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.197775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.219724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:46.220931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:46.234746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 258/520] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:46.259512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322c0c-c2ad-46fc-b44c-ab1cce87e8ab None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.278386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322c0c-c2ad-46fc-b44c-ab1cce87e8ab None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.283434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.284227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.284505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.284782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.305550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:46.313128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:46.314748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 263/521] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.321222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.330665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e69c-9938-44ca-a463-6a29e1c9fc80 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.336048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.336756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.337686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.337846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.338632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.338940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.340547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.354001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 259/522] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.360221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.371589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1c5d6-8eef-42f7-bd44-741af1c08d05 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.376163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.376964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.377250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.377527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.390382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.392362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.423515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:46.425023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 264/523] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.431013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.442923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b0ba5-0d41-4d23-9fdf-f9db2faecee3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.448997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.449733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.450016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.450345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.451116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.451475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.453155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.476793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 260/524] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.483300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.494834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072a4f-c5f0-4109-9570-0a930bb4979f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.502345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.503235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.503519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.503796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.517763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.519945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.536610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-e94289fa-03ac-42be-b307-7ef1f4c8a410 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:44:46.537835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 265/525] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.544517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.555107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c940c4-8c09-4f72-bd5d-a02f63fc4cd2 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.555418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c940c4-8c09-4f72-bd5d-a02f63fc4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.555835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c940c4-8c09-4f72-bd5d-a02f63fc4cd2 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.558309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 266/526] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:46.559213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1346e-e262-4e38-b08a-cea102227248 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.566548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.567256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.567538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.567815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.568665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.568974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.570872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.575529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.575809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.576087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.611847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:46.611847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:46.612096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 261/527] 10.222.0.73 () {56 vars in 1159 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.617615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.631541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b57a6-fd7a-4093-a09b-2b987463e6c0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.634719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 267/528] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:46.646820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.647499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.647778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.648055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.659851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.663244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.665723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.670878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f634e-9e51-49a3-bba0-f7e0db22f279 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.681536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 262/529] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:46.683949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6ea7-e0f8-4865-b196-b22105133c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.684849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6ea7-e0f8-4865-b196-b22105133c89 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.685137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6ea7-e0f8-4865-b196-b22105133c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.685462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6ea7-e0f8-4865-b196-b22105133c89 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.688338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.701299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29a61a-06c5-4f87-b3d1-e611cce8a353 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.713192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6ea7-e0f8-4865-b196-b22105133c89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:46.715814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.718396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.720998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.721493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.730642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d89c6ea7-e0f8-4865-b196-b22105133c89 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:46.732301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 268/530] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:46.739113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e115793-d5cb-42da-8b86-e903cee10be4 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.739399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e115793-d5cb-42da-8b86-e903cee10be4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.739687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e115793-d5cb-42da-8b86-e903cee10be4 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.741962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 269/531] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:46.742830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e115793-d5cb-42da-8b86-e903cee10be4 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.743461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.745855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.762521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e115793-d5cb-42da-8b86-e903cee10be4 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.769830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.769830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.769830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.769830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.770171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.770171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.770909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667ccf-50b5-4ab8-9803-1c3088c39b07 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.782402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 270/532] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.783166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:46.783794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.784094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.784369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.786842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 263/533] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.794591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.809256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ff418-56d3-4746-a1fd-b9d744feb9f9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.813731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:46.813934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.814747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.814979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:46.815099 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.815303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.823089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 271/534] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:46.823935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.835096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.835096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.835397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b77bf-cb8d-4abe-8b9e-fdb69586b718 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.840432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.841204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.841539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.841817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.842779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.842946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.844674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.855306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-3e662258-ffda-49d4-80eb-52677822848c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:46.856680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 264/535] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.857984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b0ac-1c61-4f32-89ea-5758c0bc9818 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.858254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b0ac-1c61-4f32-89ea-5758c0bc9818 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.858538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 272/536] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.858830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b0ac-1c61-4f32-89ea-5758c0bc9818 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.864308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.864684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 265/537] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:46.865631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1b0ac-1c61-4f32-89ea-5758c0bc9818 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.875711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccb511-8e57-4578-bace-dd7e668ce8a3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.880277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1b0ac-1c61-4f32-89ea-5758c0bc9818 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.880978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.881790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.882010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.882285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.886899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.887790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.888068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.888335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.894213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:46.895545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.897538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.905209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:46.912307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 273/538] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.912307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.912494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-4954acea-3bc4-46b6-b1bc-63f72ce52b54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:46.912494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 266/539] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:46.913506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.913789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.914063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.927676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399bf75-29d4-4f72-b124-be17cb382fb9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.933136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.933803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.934085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.934362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.935117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.935426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.937470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.937583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:46.938437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:46.954827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 274/540] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.954827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.955267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 267/541] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:46.956392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:46.966184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb91a-a5f1-4c2c-905b-e98fc7263a4d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.972786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f652-b0e8-46d4-a673-b87d42398e10 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:46.974284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.975273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.976347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.976627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.977437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.977719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.979438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.979537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:46.980785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:46.981571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:46.982662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:46.983421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:46.983737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:46.986085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:46.988874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 275/542] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:46.989863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.004250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6474e53-18c4-4eb8-95e9-a004cebfb0f8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.005069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 268/543] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.005973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.011733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.013256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.013716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.014175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.016991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b5580-e1bd-42f6-a7e0-2d361f799769 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.022019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.022930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.023283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.023634 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.023771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.026476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.036326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:47.040424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 03:44:47.046850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 276/544] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.046850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.047221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:47.047221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 269/545] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.047221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.056590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee09fe-2143-49ba-a0a3-0ae5a5c216f6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.060370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ebced-02c1-4968-90a7-27d03e3abd9d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.062445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.063265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.063620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.064015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.064985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=65d84bc451c5469b89788e179bfc4189) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.065093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.065450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.065998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.066342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.066740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.067762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.075434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 270/546] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/role_assignments?user.id=65d84bc451c5469b89788e179bfc4189&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.076173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.081081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.086416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.089690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08cc4-d88d-4478-a3f6-6d0b57ee6e02 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.095135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.096064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.096452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.096913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.097873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.098342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.101094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.119478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:47.121404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 277/547] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.122552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.126145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 271/548] 10.222.0.73 () {56 vars in 1159 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.131028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.137022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce815-f774-4a58-8cfd-10a28f09153b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.141987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.143087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.143517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.143774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050f3c-9422-4381-9706-27c5df14ea54 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.144095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.145284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.145854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.148187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.150095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.151232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.151627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.152064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.153009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.153424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.155328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.161879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 278/549] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.163208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.174967 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 272/550] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:47.175313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6473dbe-19e5-4c35-b9fb-8a98943a9884 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.176203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.180807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.181743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.182171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.182615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.189895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab827-be7b-4350-a9e4-c215dae67209 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.192566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.195502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.195875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.197362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.197918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.198144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.208063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 279/551] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:47.209347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.213645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.215475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.221104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084af0b-5e5b-408b-9ff4-72cc2eba502b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.226176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.227936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.228429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.228923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.234419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:47.235895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 273/552] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.236719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.238785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.241160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.248171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3adf92-eb69-4185-81fb-6787bf4e7667 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.252988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.253809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.254095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.254428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.260665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:44:47.262387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 280/553] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.263577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.271463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.273334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.274853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b92c-edfa-4766-a882-e078f46fd1b0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.281252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.282293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.282920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.283443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.284372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.284924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.286881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.294795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:47.296250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 274/554] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.296923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.302253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 281/555] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.303526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.308533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30235899-afa1-4a58-8b21-13cc83af7199 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.313572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.314260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.314543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.314855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.315763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.316078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.316651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4158c-979a-4a8f-b5c3-1e56d9c9ad6c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.317939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.323549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.324315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.324666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.325011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.325814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.326191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.327970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.346320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 282/557] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.346512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 275/557] 10.222.0.73 () {56 vars in 1157 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.346612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.351402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.358999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d67a3-acc0-41ba-8974-38264700516c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.364983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf57d-b154-45d1-b50d-24934d5b4682 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.365353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.366335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.366704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.367048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.370445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.371259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.371541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.371815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.375261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.377199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.384289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.386306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.402314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 03:44:47.404414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 283/558] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.405507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.406363 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:47.408093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 276/559] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.409977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.421755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a486c-4a64-4aad-9efd-5f7ce7cf981a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.422762 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d06-4987-47bb-b333-ebc63c02ad97 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.427930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.428750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.428879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.429222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.429603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.430209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.430850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.431001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.431336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.431822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.433371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.441360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.444792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.453802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 277/560] 10.222.0.73 () {56 vars in 1161 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.455078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.461305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:47.465123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 284/561] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.465790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.473624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede2e93-e1b1-436d-a8fd-8a74182c45bf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.486069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.486797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.487075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.487351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.488080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.488385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.489089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab03f-6ae1-40fb-abb7-af558b382d87 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.490015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.496047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.497120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.498201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.498721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.503873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 278/562] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.509836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.515146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.516519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18a73-8ac7-4dee-b41b-de8ea21d6cfe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.517520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.521961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.524079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.524079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.524079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.525363 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.525888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.528553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.533221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 285/563] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:47.534335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.543927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 279/564] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.547231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.557702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2db9-0cf7-4a27-a652-70a3dddf6bb4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.561837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc958-4b24-499d-8ad9-6ae0ea9417c3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.563960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.565306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.565665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.566008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.567766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.568807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.569306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.569775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.576403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.578881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.582917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.585060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.593769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:47.600444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 286/565] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.600444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.611249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275d3b1-cd79-45d3-a5ae-4afcb97dbce9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.612819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:47.614722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 280/566] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:47.615867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.616048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.616699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.617036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.617321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.626595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=4f148f069b014ed5baa06b408bab5d1e) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.626595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.626595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.628655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 287/567] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/role_assignments?user.id=4f148f069b014ed5baa06b408bab5d1e&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.629504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.632288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44836c4b-bed7-469b-bb47-43855c0f2e9d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.638739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.639593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.639948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.640354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.641265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.641690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.643826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.652524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829497-571c-4dc3-8018-96217b9b0e31 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.658810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 281/568] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.667995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.680854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb45b7-284c-4714-804c-f903f3e1b5cd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.687019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.688311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.688868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.689294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/8946263bd74d445f81944be54ef96070/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.691367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.692058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.692377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.692615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.693354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.693658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.695351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.707876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=8946263bd74d445f81944be54ef96070, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.710919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.721901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 288/569] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.729110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.740749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a865b1-8eae-413f-9f34-7ce7d7a7382c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.747026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.748302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.748830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.749310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.757708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.761033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.778710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:47.780899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 289/570] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:47.788269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.800196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 282/571] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:47 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/8946263bd74d445f81944be54ef96070/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:47.809135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d5e7-1961-421c-9f38-ceb8db28861e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.895264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.896363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.896861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.897334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.898370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.898933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.902479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4292e-feac-4acf-abb9-b30ea0009506 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.918192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 290/572] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:47.925585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:47.937792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73e84-e462-4104-a957-e22218aba310 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:47.943135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:47.944403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:47.944896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:47.945373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:47.947794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=40245bfc762a492587d3e4d39abea6b2) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:47.948761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:47.952604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064566-0b7a-4a31-aa98-62ca22ea4b9a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:47.960336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 283/573] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:47 2021] GET /identity/v3/role_assignments?user.id=40245bfc762a492587d3e4d39abea6b2&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:48.816087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49ba9-c391-47ab-ae12-528039d7710a None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:48.816609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49ba9-c391-47ab-ae12-528039d7710a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:48.816609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49ba9-c391-47ab-ae12-528039d7710a None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:48.818684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 291/574] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:48.825672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:48.826175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:48.826251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:48.847053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:48.848247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:48.856375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 284/575] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:48.880809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e49ba9-c391-47ab-ae12-528039d7710a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:48.893941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e49ba9-c391-47ab-ae12-528039d7710a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:48.900580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:48.901831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:48.902264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:48.902737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:48.917655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:48.924955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:48.927145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 292/576] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:48.934529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:48.949375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6234-6a83-4eba-a580-52cbb0cd55b8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:48.956025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:48.957082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:48.957533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:48.957966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:48.959268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:48.959764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:48.963225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:48.977900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 285/577] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:48.984220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:48.996072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d787e-6f70-4348-a568-2bba88584018 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.000886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.001685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.001966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.002238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.014224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.016128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.033911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:49.035492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 293/578] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:49.041946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.051956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a663ad6-d30d-4f23-98a9-6e9cc408c96d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.057201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.057866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.058148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.058428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.059186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.059499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.061092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.084266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 286/579] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:49.090913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.100964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a535e-fffd-4a98-96f2-e01b2304e634 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.110052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.110881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.111165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.111438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.120201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.122237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.141147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:44:49.142337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 294/580] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:49.151929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.162235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698b6e6-0178-4b99-8de7-aa0e2ed612d8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.167321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.167993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.168272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.168546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.169387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.169696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.171595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.198930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 287/581] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:49.205189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.218447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f37f8-c257-40a8-bd74-8001f514c844 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.225148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.225859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.226146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.226419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.236753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.238641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.257249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 295/582] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:49.264974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.279841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a7c9-3721-473d-9df3-9d0ac63623ba admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.285859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.286753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.287032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.287310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.301613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.303509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.326126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:49.327725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 288/583] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:49.333932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.344137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a897-4d9c-4e05-8ad1-dda6b9665343 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.348729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.349455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.349737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.350012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.350829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.351137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.353325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.365947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 296/584] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:49.372132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.384934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35c5bb-c49b-4ab3-914d-5fabdf80665b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.389687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.390483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.390789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.391120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.398848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.401475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.416096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:49.417998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 289/585] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:49.424341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.435193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f49f-1765-4c9a-a6cf-455d701cbe5c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.440083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.440828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.441111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.441390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.442275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.442613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.444690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142f53-3460-4e52-a7b8-1ab34d2aefac admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.459848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 297/586] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:49.467290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.481161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8705e-9a23-4a38-83bf-a423e016e3ed admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.486006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.486741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.487024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.487305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.488196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=bb32cee436d24774b51fa67a73ef342d) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.488562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.490591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3370-ee3d-4d9e-9700-a972471308da admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.499177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 290/587] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/role_assignments?user.id=bb32cee436d24774b51fa67a73ef342d&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:49.701081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0ec9-3d33-48e5-9859-306566f63f51 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.701465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0ec9-3d33-48e5-9859-306566f63f51 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.701657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0ec9-3d33-48e5-9859-306566f63f51 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.703645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 298/588] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:49.710194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.710497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.710778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.735640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:49.736861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:49.745456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 291/589] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:49.781969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c0ec9-3d33-48e5-9859-306566f63f51 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.797224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c0ec9-3d33-48e5-9859-306566f63f51 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.804225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.805076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.805435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.805720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.806427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.807496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:49.807496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:49.807496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:49.808443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.822628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 03:44:49.824285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 299/590] 10.222.0.73 () {56 vars in 1151 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:49.830833 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.841143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb7ef5-f044-49be-b551-091ec927105d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.846972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.847742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.848025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.848298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.849074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.849396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.850463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:49.850463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:49.850463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:49.851385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdc4e1-7db5-475b-b3b2-ddd9043ee819 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.857498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 292/591] 10.222.0.73 () {56 vars in 1146 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:49.865312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:49.880493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a913e-623b-45af-a719-99d031ee1897 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:49.891150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:49.891882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:49.892165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:49.892443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:49.893270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:49.893576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:49.894667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:49.894667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:49.894667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:49.895630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b63a36-7c74-42c6-81e0-f6e8c7f5f76a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:49.903636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 300/592] 10.222.0.73 () {56 vars in 1146 bytes} [Fri Aug 27 03:44:49 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:50.556866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ed1e-f7b3-4f83-bb6f-54e1fd703be3 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.557216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ed1e-f7b3-4f83-bb6f-54e1fd703be3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.557443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ed1e-f7b3-4f83-bb6f-54e1fd703be3 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.559233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 293/593] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:50.565572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.565861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.566137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.588541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:50.589747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:50.598031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 301/594] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:50.643916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291ed1e-f7b3-4f83-bb6f-54e1fd703be3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:50.658839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291ed1e-f7b3-4f83-bb6f-54e1fd703be3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:50.663378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:50.664219 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.664504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.665379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.678950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:50.686084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:50.687402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 294/595] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:50.693921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:50.703501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648930c-42a8-42b7-8b99-d306c746efc6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:50.712017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:50.712931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.713279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.713547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.714361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:50.714689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:50.716385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:50.725813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 302/596] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:50.732685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:50.743920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0327d81-c890-4138-9712-88257b1700d2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:50.751265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:50.752086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.752369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.752645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.768760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:50.770644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:50.792512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:50.794062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 295/597] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:50.799946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:50.814968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9912df-c33f-459b-84fe-e55ee0fe52bd admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:50.825885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:50.826674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.826878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.827158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.827912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:50.828230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:50.829923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:50.846435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 303/598] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:50.855623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:50.872614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80fd7-a1e3-46e5-8c9a-856795941492 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:50.878415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:50.879299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.893135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.893135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.893135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:50.893135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:50.907471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-ea1330b8-4c48-4be1-9159-3b66f2e23870 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:44:50.909014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 296/599] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:50.915094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:50.930514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e747-ddc0-4847-be8a-68ad767b1377 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:50.938190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:50.938905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.939240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.939510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.940358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:50.940716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:50.942703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:50.963118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8297b-ca75-41ce-9b5a-35e1e77cf706 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.963430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8297b-ca75-41ce-9b5a-35e1e77cf706 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.963667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8297b-ca75-41ce-9b5a-35e1e77cf706 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.965500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 297/600] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:50.973665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:50.973665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:50.973665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:50.975204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 304/601] 10.222.0.73 () {56 vars in 1157 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:50.988863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.009833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62aeb-c3c6-4dee-bfc1-e85a0d7fe93c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.011705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:51.012967 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:51.020862 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.021576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.021835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.022117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.033952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 298/602] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:51.040983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.043385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.059707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.061271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 305/603] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:44:51.070357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.075818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0bd9-9663-43c9-a663-3e1ceae79a1b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.080587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.081232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a44b-5b57-4846-9bc3-7669a9023475 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.081542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.081892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.082241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] PATH_INFO: `/v3/services/network` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.090609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.090609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:51.090609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:51.090609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:51.090609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.095768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.096844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.097366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.097774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.099898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 03:44:51.101491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 299/604] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:51.108953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.120542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cba81-15cd-4589-ad25-2dc50867cadf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.120910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.123197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.136389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.137371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.137797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.138308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.139415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:51.139925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.144223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.154515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-51d22774-99b6-4f86-9668-14276915b4b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:51.156316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 306/605] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:51.157758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391b814-c0f7-40c1-b3bb-7c72a814ecd5 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.157881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 300/606] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:51.158299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391b814-c0f7-40c1-b3bb-7c72a814ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.158743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391b814-c0f7-40c1-b3bb-7c72a814ecd5 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.160839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 307/607] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:51.169075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.169260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391b814-c0f7-40c1-b3bb-7c72a814ecd5 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.180974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f2cd-3087-445b-8edd-9fda655b9ee1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.184291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391b814-c0f7-40c1-b3bb-7c72a814ecd5 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.186451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.187189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.187482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.187800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.188491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:51.188796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.190636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6523b-0218-4a60-90f4-10fcd7eecf98 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.191019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.191895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.192405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.192834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.193790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:51.194295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.196274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.197686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 301/608] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/services?type=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:51.207234 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace325-306a-4381-8248-07e455021083 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.207527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace325-306a-4381-8248-07e455021083 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.207811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace325-306a-4381-8248-07e455021083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.211106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 308/609] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:51.217696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.230326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a58f61-942e-456d-a9ef-952e765fce0a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.235429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.236560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.237037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.237469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.244901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e7ace325-306a-4381-8248-07e455021083 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:51.246210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e7ace325-306a-4381-8248-07e455021083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:51.247334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.249675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.266304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:51.268357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 309/610] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:51.275841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.280921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 302/611] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:51.294509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170917-0272-4819-bf6d-12d7f87d210c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.302320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.307654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.308179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.308653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.309676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:51.310226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.312462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.327478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 310/612] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:51.335784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ace325-306a-4381-8248-07e455021083 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.341754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.348559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ace325-306a-4381-8248-07e455021083 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.352540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1dde-5deb-4d61-b21c-c86c5b94d095 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.357950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.359275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.359708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.359847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.360333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.360668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.361043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.361414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.362373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8946263bd74d445f81944be54ef96070) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:51.362831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.364839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.375129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.377316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.378491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 303/613] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/role_assignments?user.id=8946263bd74d445f81944be54ef96070&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:51.403842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:51.411292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 311/614] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:51.418264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.440868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d36d3-baf9-49cb-8130-007c78fe8ce0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.447963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.448929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.449470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.449957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.451453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:51.451790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.453507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd432-3c1f-4e63-b9aa-05f30fe730e7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.469755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 304/615] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:51.476712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:51.490434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cdb51-546e-47bb-bd2b-83c637eb80b7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:51.497151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c20bb-bed0-4e74-931d-aedb7cce7b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:51.498221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c20bb-bed0-4e74-931d-aedb7cce7b1b admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:51.498763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c20bb-bed0-4e74-931d-aedb7cce7b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:51.499254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c20bb-bed0-4e74-931d-aedb7cce7b1b admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:51.500189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c20bb-bed0-4e74-931d-aedb7cce7b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:51.502365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c20bb-bed0-4e74-931d-aedb7cce7b1b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:51.613588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 312/616] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:44:51 2021] POST /identity/v3/users => generated 254 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:52.183299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bedace-684b-418a-a2d8-0060c8c0f18d None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.183811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bedace-684b-418a-a2d8-0060c8c0f18d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.183911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bedace-684b-418a-a2d8-0060c8c0f18d None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.186328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 305/617] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:52.193788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.194723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.195205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.219455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:52.221027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:52.232280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 313/618] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:52.258015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bedace-684b-418a-a2d8-0060c8c0f18d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.275093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bedace-684b-418a-a2d8-0060c8c0f18d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.282622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.283436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.283723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.284003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.303661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:52.311356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:52.312941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 306/619] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:52.319755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.331687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890a87e-d807-495d-9992-3879f76ed453 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.344849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.345546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.345829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.346102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.346892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:52.347197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.348803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.366247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 314/620] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:52.372515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.388602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f697cb-11e8-495c-b4b6-4d36a5b8d5ce admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.398880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.400391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.400679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.400955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.422656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.424539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.454884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:52.456454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 307/621] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:52.463199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.476420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f65e30-b026-4394-933e-3f90bb495998 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.492282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.492977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.493464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.493965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.494737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:52.495054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.496675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.518972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 315/622] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:52.525897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.540250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb26467-800b-47c2-95e7-d496acca1494 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.546835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.547934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.548408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.548875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.568210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.570596 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.592253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:44:52.599054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 308/623] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:52.601112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.621158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf2d5-9cd4-46f5-9a14-edcf14be0514 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.629251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.629986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.630271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.630542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.631465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:52.631768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.634491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.662172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 316/624] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:52.668958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.684357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4279-95fd-439d-8d50-8be7efb0c08d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.689283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.690341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.690844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.691333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.708684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.710916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.736750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:52.744145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 309/625] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:52.746852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.768531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd454d-78f8-4a35-9f10-34bba165c18e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.781311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.782011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.782293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.782591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.783414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:52.783718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.785487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c269-7be3-4bf8-8fe7-0ab0ec730fe0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.808113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 317/626] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:52.814100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.827725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69a558-26db-4d3a-9078-47d5435c00d0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.832783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.833862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.834357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.834845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.845983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776321-03f9-4dd8-9a83-83012b98f478 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.846319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776321-03f9-4dd8-9a83-83012b98f478 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.846585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776321-03f9-4dd8-9a83-83012b98f478 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.848856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 318/627] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:52.854174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.854749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.855043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.855327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.856221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.875689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:52.883085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 310/628] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:52.885130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.895552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:52.896765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:52.904668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087ed3-16a4-4464-b187-8c97dc458b94 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.911043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 319/629] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:52.921411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.922094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.922375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.922670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.923478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:52.923787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.925668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.940352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 311/630] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:52.946085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.948110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:52.959005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0495ef-501f-457b-bde6-e90d3be6cbc9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.962783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb429-e124-4913-9490-b218ae03dac1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:52.968731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcacba-8072-4863-bff9-04116adddb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.969635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcacba-8072-4863-bff9-04116adddb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.969916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcacba-8072-4863-bff9-04116adddb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.970189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcacba-8072-4863-bff9-04116adddb9c admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/bb32cee436d24774b51fa67a73ef342d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.972973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcacba-8072-4863-bff9-04116adddb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=bb32cee436d24774b51fa67a73ef342d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.975670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcacba-8072-4863-bff9-04116adddb9c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:52.977260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:52.978206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:52.978714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:52.979181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:52.980307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:52.981663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:52.981663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:52.981663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:52.983774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04d677-2c9b-4937-a735-ba4e1efe46e0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:53.094787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 312/631] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:52 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/bb32cee436d24774b51fa67a73ef342d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:44:53.145412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 320/632] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:44:52 2021] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:53.902928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22053-38c9-432d-88b9-7652e80edcfd None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.007186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22053-38c9-432d-88b9-7652e80edcfd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.007186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22053-38c9-432d-88b9-7652e80edcfd None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.007186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 313/633] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:54.007947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf79b4e-5667-4c27-8592-1ac7e8c7f9da None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.007947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf79b4e-5667-4c27-8592-1ac7e8c7f9da None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.007947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf79b4e-5667-4c27-8592-1ac7e8c7f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.007947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fdf79b4e-5667-4c27-8592-1ac7e8c7f9da None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:54.007947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fdf79b4e-5667-4c27-8592-1ac7e8c7f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:54.016863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 321/634] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:53 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:54.064020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22053-38c9-432d-88b9-7652e80edcfd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.077864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22053-38c9-432d-88b9-7652e80edcfd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.082478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.083273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.083562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.083841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.084665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.085668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:54.085668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:44:54.085668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:44:54.087152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed608cc-9cb8-4a1f-91f2-59fa072bad31 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.151371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 314/635] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:44:54 2021] POST /identity/v3/services => generated 240 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:54.394051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714c27c-3e17-4b31-8b9a-ea8d7efb1aec None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.394375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714c27c-3e17-4b31-8b9a-ea8d7efb1aec None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.394628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714c27c-3e17-4b31-8b9a-ea8d7efb1aec None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.396713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 322/636] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:54.403519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.404130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.404612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.429173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:54.431557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:54.472388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 315/637] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:54 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:54.499476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714c27c-3e17-4b31-8b9a-ea8d7efb1aec None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.516602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714c27c-3e17-4b31-8b9a-ea8d7efb1aec None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.522725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.523898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.524476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.524951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.536677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:54.546738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:54.548671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 323/638] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:54.556551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.573476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ceb67-b9f5-42bf-8e17-a36d8436d156 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.582705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.583413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.583697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.583974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.584749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:54.585059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.587378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e37552-ac43-428b-af60-5950404c9fcf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.604115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 316/639] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:54.610415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.623841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2088d8-8b7f-4d60-94ea-871675717975 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.631726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.632853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.633995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.634539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.655095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.656604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0c78d-8002-4758-bf75-9a60ae6779f5 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.657014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.657118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0c78d-8002-4758-bf75-9a60ae6779f5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.657592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0c78d-8002-4758-bf75-9a60ae6779f5 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.663966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 317/640] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:54 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:54.670928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.671215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.671498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.676406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:54.677952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 324/641] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:54.685211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.707018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aa0b4-b2b7-44fa-a81e-83484292df9b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.714282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:54.716562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:54.718921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.719602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.719936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.720215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.720951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:54.721311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.723199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.741980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 318/642] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:54 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:54.749624 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 325/643] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:54.755858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.766485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db73b-bbca-451c-8e80-bd25624cfa3b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.771658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.772030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.773229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.773705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.774926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.784093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad415a4-8bde-4c7d-a7e9-76e296da0fbb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.789382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.790482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.791014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.795488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.797406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.799698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.826896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:44:54.827826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:54.837065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 319/644] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:54.837453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:54.839243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 326/645] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:54.845844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.852050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.857871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7a69-3488-4df8-8a44-2093f01bcf41 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.864291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.864991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.865330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.865608 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.866517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:54.867250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.869335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9babc1a-0d2b-4f30-899e-4e46375a4660 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.869461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.887357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.888054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.888339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.888617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.889384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:54.889692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.890366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 320/646] 10.222.0.73 () {56 vars in 1171 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:54.891380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.897281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.909597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493270e-3781-4a1e-b11f-f219a9e0e9c4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.910264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 327/647] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:54.915227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.916200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.916936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.917358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.917493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.935054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:54.937124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:54.939845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f3cf6-241d-4663-b563-ada5a4e9a4fc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.953430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 321/648] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:54.954664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:54.965154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d183dd-1939-4e69-b817-d9879a36f926 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:54.967537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.968939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.969253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.969835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.977860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:54.979146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:54.980016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:54.980516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:54.999057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.001265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.003515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.005325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.020844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:55.022333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 322/649] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:55.031480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.035715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:55.045910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 328/650] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:55.048545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb07727-9d3a-4ed3-b580-5505f9bd8d25 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.054509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.060890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.061558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.061836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.062109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.062897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.063199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.065410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.071986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8545b-01de-4a27-ace0-fa5bebe4a827 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.091903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 323/651] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.092843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.095059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.095733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.096007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.096276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.097006 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.097306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.098940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.115660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b28d8-b457-412c-93f2-cf8ad4ea8144 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.124354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 329/652] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.131161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.132138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.132936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.134022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.134301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.150614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b2f3-6952-4600-8212-ea5e4b0b813a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.152035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.154024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.165486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.166213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.166769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.167037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.174535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:55.178693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 324/653] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:55.182513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.184866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.186907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.193862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a33881-a08d-41b5-873b-5491bbabc0cf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.199469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.200549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.201036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.201562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.202637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.203154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.205286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.217393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:44:55.218950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 330/654] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:55.220333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 325/655] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:55.228198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.228398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.238649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d7ac0-9e18-42cc-8ede-1ea5d47c4200 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.245086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570be2e5-b5bd-4a29-b08d-ec7d08b73cb5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.249430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.250114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.250394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.250692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.251535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.251841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.253691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.264345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.265020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.265297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.265569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.266403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8bd4fc72719c45568c1a2018a1457e42) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.266751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.268614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.281762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 326/656] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/role_assignments?user.id=8bd4fc72719c45568c1a2018a1457e42&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.287582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 331/657] 10.222.0.73 () {56 vars in 1157 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.295913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.306467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2c40-d990-4bf9-8a6d-d9e1e2f46f75 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.315340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.316014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.316289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.316560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.330719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.332480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.344711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 327/658] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:55.350954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.362274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470b677-d6a5-4714-971c-e324627de66c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.374450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.375290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.375569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.375842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.389029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.391841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.417579 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:55.419086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 332/659] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:55.426836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.436898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676802-9dad-4b25-a042-d7000efe5f6b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.441830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.442505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.442822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.443096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.443825 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.444128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.445836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.459336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 328/660] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.465740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.476142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb438-b476-443d-bf1c-73f585ccf4b0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.482935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.483878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.484259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.484635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.503960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.505968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.530358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:55.531930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 333/661] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:55.538267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.554152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27315a9b-7945-4747-9389-ca1b2d2a10d6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.559813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.560687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.561104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.561514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.570625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.571428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.573543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0325581-8b71-4301-8867-e7ef888a92fb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.589749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 329/662] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.596628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:55.616136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843a7b-6c1e-4465-ac9c-71a9b8091ecf admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:55.621916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:55.622832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.623274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.623724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.624715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8946263bd74d445f81944be54ef96070) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:55.625153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:55.627240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f5fed-0a1e-4fc3-bfed-adc87928a0a8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:55.639814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 334/663] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:55 2021] GET /identity/v3/role_assignments?user.id=8946263bd74d445f81944be54ef96070&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:55.948044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0b7b-2ff2-4133-8e5a-f4a33e5a57b1 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.948891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0b7b-2ff2-4133-8e5a-f4a33e5a57b1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.948891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0b7b-2ff2-4133-8e5a-f4a33e5a57b1 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.951085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 330/664] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:55.968746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:55.969041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:55.969246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:55.990656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:55.991856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:56.001678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 335/665] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:55 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:56.037163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0b7b-2ff2-4133-8e5a-f4a33e5a57b1 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.052388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0b7b-2ff2-4133-8e5a-f4a33e5a57b1 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.057717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.058584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.058879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.059154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.059807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.061460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.077322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 03:44:56.078710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 331/666] 10.222.0.73 () {56 vars in 1151 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:56.085282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.096493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd857-310d-4cbd-946a-0b1a3151d821 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.101211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.102632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.102920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.103195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.104045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.104349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.106128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.115768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 336/667] 10.222.0.73 () {56 vars in 1146 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.122216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.136809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc87b8-6588-4ff0-8706-940bc0d00632 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.141724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.142441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.142757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.143032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.143802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.144107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.145762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.155108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 332/668] 10.222.0.73 () {56 vars in 1146 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.161575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.172125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7cdd-294d-4a29-b5cb-52d1099ee8b8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.176847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.177507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.177829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.178104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.178972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] RBAC: Adding query filter params (interface=public, service_id=361710c86ce6432e94d2ef658616ae0a, region_id=RegionOne) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.179282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.180554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:56.180554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:56.180554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:56.181563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e8c6-c9a8-4faa-a211-ffc2c9f5098d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.193911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 337/669] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/endpoints?service_id=361710c86ce6432e94d2ef658616ae0a&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.200955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.209601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4fb42-7eb7-4d1f-8727-656ac7141c0e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.209889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4fb42-7eb7-4d1f-8727-656ac7141c0e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.210298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4fb42-7eb7-4d1f-8727-656ac7141c0e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.212929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 338/670] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:56.213803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537471-1831-4ac6-b071-565705de4a66 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.222741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.223679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.224167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.224646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.225525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.228559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.229263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.229552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.229833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.235450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 333/671] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.252669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:56.253867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:56.262677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 339/672] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:56 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:56.286725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.306403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b73c-a155-41a0-9bc8-6ede4e022f93 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.313770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.314631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.314919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.315190 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.333872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:56.341529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:56.343214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 334/673] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:56.349884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.368861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439642f-353c-4b08-923d-36c6a16c517d None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.384726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.385427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.385710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.385984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.386844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.387153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.388776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.403481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 340/674] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.409776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.423072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29e3f-2f85-4f6a-9d65-19c87079fe93 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.433135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.433954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.434288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.434634 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.450939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.452935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.472770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:56.474312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 335/675] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:56.481664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.496866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559a33-9f1a-49b5-969a-2903d65efa5f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.507655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.508580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.508872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.509270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.510017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.510378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.512084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.530424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 341/676] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:56.536464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.548035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87791f-6426-4211-b3ba-fb10760422b9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.552890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.553721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.554014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.554291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.563407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.565512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.579678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:44:56.581293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 336/677] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:56.587973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.600529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9071f-6e38-4acc-936b-dfcf2aae5164 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.606155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.606909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.607194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.607474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.608380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.608685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.610630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.636953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 342/678] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:56.643483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.660219 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d9f2-f35f-439c-a5c0-a8bc6a54b375 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.667296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.668062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.668343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.668623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.683136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.685266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.700723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 337/679] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:56.707322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.724010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021bf5-7e19-4dcc-9052-7f2b4effcb0d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.737459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.738277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.738576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.738860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.755381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.757293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.790463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:56.792390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 343/680] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:56.798274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.814643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef269-9fa1-44cc-8b06-af4af797aa6c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.828026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.829070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.829578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.830077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.831032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.831541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.833380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.853531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 338/681] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.859725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.872610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b24d6-00e9-4d39-b540-3f4e549e1507 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.888314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.889131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.889409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.889685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.902986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.904972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.923020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:56.924578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 344/682] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:56.930928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:56.947767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95eb9-9b04-4b34-a142-133c271e9de9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:56.957483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:56.958870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:56.959335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:56.959811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:56.960784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:56.961823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:56.968720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345bc1b-a549-4410-b875-0a3f0ceea931 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:56.987898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 339/683] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:56.997225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.014008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f7b2-ae3a-4e1d-990b-4ed8758e3af3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.028170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.028850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.029131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.029406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.030258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=bb32cee436d24774b51fa67a73ef342d) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:57.030585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:57.032501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649924-2890-4ba5-81c9-66fdc7a0ec49 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:57.040139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 345/684] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:44:56 2021] GET /identity/v3/role_assignments?user.id=bb32cee436d24774b51fa67a73ef342d&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:57.122424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeacf1-2245-4e85-8d1e-ed8d30f38772 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.122753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeacf1-2245-4e85-8d1e-ed8d30f38772 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.123197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeacf1-2245-4e85-8d1e-ed8d30f38772 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.125428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 340/685] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:57.131551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.132033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.132106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.161537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:57.162789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:57.176712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 346/686] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:57.213284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeacf1-2245-4e85-8d1e-ed8d30f38772 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.232337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeacf1-2245-4e85-8d1e-ed8d30f38772 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.237040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.237848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.238128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.238405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.239123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:57.240743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:57.258362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 03:44:57.259839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 341/687] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:57 2021] GET /identity/v3/services/network => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:57.267004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.277171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c24c5-070c-4142-8402-09f83b241834 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.295384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.296067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.296348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.296619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.297342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] RBAC: Adding query filter params (name=network) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:57.297643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:57.299302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:57.304804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 347/688] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:44:57 2021] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:57.311761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.328044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e99e-873a-4c0c-833e-b76b3b9d0825 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.341369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.342057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.342342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.342680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.343371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:57.343682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:57.345308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:57.356272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 342/689] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:44:57 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:57.362400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.374481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f449-8509-4c12-a9cc-de6603d84def admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.380016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.381149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.381615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.382113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.383811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] RBAC: Adding query filter params (interface=public, service_id=486687f2cb7240ad9b7c1c2c38f6794f, region_id=RegionOne) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:57.384424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:57.386294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47ae0-c732-43bc-be64-ec67dfef40c7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:57.393102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 348/690] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:44:57 2021] GET /identity/v3/endpoints?service_id=486687f2cb7240ad9b7c1c2c38f6794f&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:57.400203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.410793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3545-00c7-42c8-9a21-c097e2ed4a35 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.417284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3d19e-141e-4fd3-921e-2d0ea55add3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.418302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3d19e-141e-4fd3-921e-2d0ea55add3a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.418793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3d19e-141e-4fd3-921e-2d0ea55add3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.419256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3d19e-141e-4fd3-921e-2d0ea55add3a admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.420207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3d19e-141e-4fd3-921e-2d0ea55add3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:57.422078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3d19e-141e-4fd3-921e-2d0ea55add3a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:57.428480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 343/691] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:44:57 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:57.890032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bb50d-9032-4b61-a49a-839285affe96 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.890442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bb50d-9032-4b61-a49a-839285affe96 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.890658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bb50d-9032-4b61-a49a-839285affe96 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.892800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 349/692] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:57.900300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.900600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.900856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:57.926988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:57.928201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:57.941957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 344/693] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:57.966807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bb50d-9032-4b61-a49a-839285affe96 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:57.985045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bb50d-9032-4b61-a49a-839285affe96 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:57.997234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:57.997234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:57.997234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:57.997234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.016179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:58.023198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:44:58.025190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 350/694] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:44:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:58.032419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.047874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc919b-f59b-4e34-97e8-5f1940c09ccd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.058493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.059229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.059511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.059786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.060558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.060867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.062491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.075529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 345/695] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:58.081516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.095918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5152-4453-457b-8f78-62c2d017bc6a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.107275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.108091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.108375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.108649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.130599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.132481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.161347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:58.166683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 351/696] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:58.169584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.184680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b78e2-2a28-4768-abf4-3d6e8da8de7f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.200424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.201475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.201987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.202467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.203429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.203976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.205803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.228247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 346/697] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:58.234693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.248503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1aeae-1d2e-4b55-aa09-8ae6b2ca9ade admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.263335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.264169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.264447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.264718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.279934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.281991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.306637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:44:58.313307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 352/698] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:58.314911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.328651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d4d7-c882-4384-a5d4-494b3a7009b4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.344332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.345376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.345903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.346377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.347488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.348004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.350065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.384474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 347/699] 10.222.0.73 () {56 vars in 1171 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:58.390429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.407824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1d1a-fc73-4ee7-a4e4-81ca22ca4196 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.420550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.421288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.421571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.421847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.441453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.443396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.466457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:58.468381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 353/700] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:58.474514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.499989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ea46-d213-43a3-b45d-c4ad42c4033e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.507868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.509494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.510006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.510483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.511447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.511960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.513762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dae9b-c78b-49d2-ae27-4e1d6b75a360 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.527431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 348/701] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:58.533758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.544541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e69b1-bb70-4a6e-8882-e04d2048ee32 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.559258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabeab5-55f8-4db6-83b0-bda739499cbc None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.560459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabeab5-55f8-4db6-83b0-bda739499cbc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.561312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.562347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.562855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabeab5-55f8-4db6-83b0-bda739499cbc None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.564871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 349/702] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:58 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:44:58.565386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.565888 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.578357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.580684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.590534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.590534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.590534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.613479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:58.615823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:58.617052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:58.625036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 354/703] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:58.627079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.639222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 350/704] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:58 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:58.649299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c1d18-70e1-4b71-b9b2-90078ab1fd47 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.655848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.656574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.656857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.657187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.657988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.658296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.660361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.667982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.677895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a0e4-f6f1-4971-afea-da93319e0a3f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.688778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.689639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.689919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.690193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.697322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 355/705] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:58.703874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.716241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:44:58.723881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d660a-5bf3-4f1a-95a9-0993b6201b7e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.731141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:44:58.733283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.734325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 351/706] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:58.735199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.735482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.735859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/8bd4fc72719c45568c1a2018a1457e42/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.747706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.757544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=8bd4fc72719c45568c1a2018a1457e42, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.760725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.766149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a93e3-b19d-406a-b12e-d08e89f12901 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.774173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.774173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.774173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.774173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.782152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.782152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.782152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.786281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 352/707] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:58.793976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.803803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ff2e-cff9-4463-b9ff-e3884f05f381 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.809016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.809818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.810098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.810370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.822249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.824130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.844328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:58.846121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 353/708] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:58.853966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:58.871324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 356/709] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:58 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/8bd4fc72719c45568c1a2018a1457e42/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:58.874725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c39b8-0f3a-4ebd-8f06-42d9b2aa4b47 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:58.950113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:58.951420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:58.951979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:58.952500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:58.953476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:58.954046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:58.955991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:58.984011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 354/710] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:44:58.990658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.011891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3a3e3-1005-4fd4-80b4-520ac6adffc9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.017524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.018718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.019237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.019769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.034248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.036703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.053592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-498eca3d-0b4d-40dc-b004-466ca1576e25 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:44:59.056052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 357/711] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:44:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:59.063057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.067156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb379c9e-6255-42c5-bce4-19a4f40adc38 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.067445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb379c9e-6255-42c5-bce4-19a4f40adc38 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.067724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb379c9e-6255-42c5-bce4-19a4f40adc38 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.069838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 358/712] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:44:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:44:59.076737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.077013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.077315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.078843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94693-3d0a-4f28-8478-b96f3e188276 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.084569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.085686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.086339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.087314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.089181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:59.089949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.093420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.115497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:59.116739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:59.134445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 355/713] 10.222.0.73 () {56 vars in 1157 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:59.141369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.141689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 359/714] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:44:59 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:44:59.152853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7221-6568-41f3-beee-fd0b34bc91e4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.162976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.164776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.165301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.165814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.183129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.185397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.196936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.207918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc96ae-efbc-47cc-967b-882967ed4894 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.215180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:44:59.215663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 356/715] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:59.219557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.221334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.222062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.222336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.223131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.224485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.227585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.234354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a003d-1e55-4272-b920-adb11c67d6f9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.244167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 03:44:59.245992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 360/716] 10.222.0.73 () {56 vars in 1151 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:44:59.252416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.253089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.253368 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.253637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.254362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:59.257345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.257345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.259377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.272580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 357/717] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:59.275570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e275408-4b81-4591-b61d-2e01029d77cd admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.279191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.281071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.282034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.282516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.283040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.283952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:59.284461 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.286617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.294186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 361/718] 10.222.0.73 () {56 vars in 1146 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:59.297536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae2155-da36-409f-b82b-cddf192815fb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.303936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.306238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.308182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.308469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.308745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.324471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d63865-d59a-49cd-9482-e7573f43599e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.325942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.328081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.335789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.336511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.338348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.338678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.339482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:59.341771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.344939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.358609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 362/719] 10.222.0.73 () {56 vars in 1146 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:59.359375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:44:59.361007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 358/720] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:44:59.364953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.368311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.376439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da45a13-2106-4004-a7e3-f4c4f8fd11b8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.381330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.382113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.382401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.382746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.384131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.385166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:44:59.385166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:44:59.385166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:44:59.386293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dc54f-7065-40ad-9f36-a71de4d3c885 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.392997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139333a-eda0-430d-9409-3b9046a41af7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.401400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.402393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.402851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.403181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.403983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:44:59.404289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.406128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.420323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 359/721] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:44:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:44:59.427123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:59.437918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7afd-ee60-4bd7-880e-656b25a6aa19 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:59.443275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205afa-18d7-4a44-a97c-09757912fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:59.444221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205afa-18d7-4a44-a97c-09757912fd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:59.444495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205afa-18d7-4a44-a97c-09757912fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:59.444817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205afa-18d7-4a44-a97c-09757912fd7c admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/8946263bd74d445f81944be54ef96070/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:59.447695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205afa-18d7-4a44-a97c-09757912fd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=8946263bd74d445f81944be54ef96070, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:59.450631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205afa-18d7-4a44-a97c-09757912fd7c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:59.573856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 363/722] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:44:59 2021] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:44:59.610516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 360/723] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:44:59 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/8946263bd74d445f81944be54ef96070/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:45:00.102032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e1b1-9252-40d3-a1f9-c2e57706611a None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.102976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e1b1-9252-40d3-a1f9-c2e57706611a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.103481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e1b1-9252-40d3-a1f9-c2e57706611a None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.105504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 364/724] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:00.121035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d2fc-75f4-4f76-949e-0a2f56cac493 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.122070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d2fc-75f4-4f76-949e-0a2f56cac493 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.122552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d2fc-75f4-4f76-949e-0a2f56cac493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.143891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e3a3d2fc-75f4-4f76-949e-0a2f56cac493 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:00.145466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e3a3d2fc-75f4-4f76-949e-0a2f56cac493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:00.232378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 361/725] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:00 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:00.270137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e1b1-9252-40d3-a1f9-c2e57706611a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.288707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e1b1-9252-40d3-a1f9-c2e57706611a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.294183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.295321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.295825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.296314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.297170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.299164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.316944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 03:45:00.318539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 365/726] 10.222.0.73 () {56 vars in 1154 bytes} [Fri Aug 27 03:45:00 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:00.319310 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b11b2-7a83-4250-ae69-8606633ca013 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.319706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b11b2-7a83-4250-ae69-8606633ca013 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.319993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b11b2-7a83-4250-ae69-8606633ca013 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.323972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 362/727] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:00.326812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.329390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.329666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.329949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.339695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e602b11-7e4e-4723-bf77-cff2663083d6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.348509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:00.348668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.349584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.349690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:00.350202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.350806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.352754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:00.353563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.355614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.362673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 363/728] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:00 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:00.366849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 366/729] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:00 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:00.373597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.388837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c24c-758f-4773-9c57-c9f1cc6330bc None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.396286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.398529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.399797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.400091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.400349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.401069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:00.401373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.403014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.408929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 364/730] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:00 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:00.418172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f6814-3e00-4398-a918-e5ba1c533193 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.423369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.424507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.425067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.425540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.426387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.428246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.440742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 03:45:00.442629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 367/731] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:00 2021] GET /identity/v3/services/network => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:00.449515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.469313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4feb5-104f-411c-8010-9596cded7a11 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.484116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.484723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.485006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.485282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.486005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] RBAC: Adding query filter params (name=network) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:00.486315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.487959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.499151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 365/732] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:00 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:00.505684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.522608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28b987-9d8d-49b4-8b1d-e923adc0a913 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.529520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.530636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.531190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.536941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.538186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:00.538819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.541969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18cb86-b936-4d5f-ab24-2e9253496d27 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.556253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 368/733] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:00 2021] GET /identity/v3/services?type=network => generated 350 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:00.567738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:00.589322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472bbce-1d38-4891-833e-e9b2a30b4e5d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:00.611475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:00.612171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:00.612462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:00.612741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:00.613496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:00.614517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:45:00.614517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:45:00.614517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:45:00.615441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e75ae-5b1a-452a-9652-00a2e1aa0f19 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:00.739973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 366/734] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:00 2021] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:01.621517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd7ca-65ca-4a62-b780-0a85a6c990e9 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.622067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd7ca-65ca-4a62-b780-0a85a6c990e9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.622067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cd7ca-65ca-4a62-b780-0a85a6c990e9 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.624376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 369/735] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:01.630518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.631000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.631099 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.652366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:01.654226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:01.673001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 367/736] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:01.698320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cd7ca-65ca-4a62-b780-0a85a6c990e9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:01.710807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cd7ca-65ca-4a62-b780-0a85a6c990e9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:01.715438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:01.716239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.716515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.716788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.729137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:01.736070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:45:01.737657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 370/737] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:01.745033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:01.754528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e97b7-914d-4718-9e63-32c4ac1f7573 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:01.759417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:01.760090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.760368 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.760637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.761388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:01.761673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:01.763329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:01.772764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 368/738] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:01.779673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:01.795732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86246a5-e3f6-4b89-ae00-afb50fb9d8e2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:01.800527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:01.801380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.801660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.801986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.813788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:01.815724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:01.834698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:01.836923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 371/739] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:01.843193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:01.854911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157e90-247c-4951-9e3b-ea174b040c0c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:01.861799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:01.861799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.862519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.863096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.864070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:01.864650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:01.866539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:01.886154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 369/740] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:01.888499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:01.899309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa1490-1b99-4810-a4bf-b5304e9566dc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:01.904066 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:01.904882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.905161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.905433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.914994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:01.917590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:01.934200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:45:01.935757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 372/741] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:01.941934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:01.952494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ad76-32ed-4477-ab88-ae7e82e3ca18 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:01.957753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:01.958468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:01.958810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:01.959102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:01.960074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:01.960378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:01.963045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:01.984512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 370/742] 10.222.0.73 () {56 vars in 1171 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:01.990663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.001451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf3ba-4dd9-4540-aa6f-d5348a6dacd0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.006804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.007507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.007916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.008913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.017759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.019612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.029912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 373/743] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:01 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:02.036199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.051307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce74fa6-3cdb-46cd-834d-49f90de548f5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.058085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.059543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.060037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.060528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.075108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.078473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.104029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:02.106295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 371/744] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:02.113083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.123032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493c62-320e-4dac-a65b-66d5e174b6b2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.127799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.128466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.128756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.129031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.129755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.130061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.131746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.145236 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 374/745] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.152743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.167159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b9800-2765-4035-827d-caafceab23d6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.173527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.174386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.174706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.175081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.186896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.189369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.207216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:02.209946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 372/746] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:02.219229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.233631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044852-cac9-4b5f-9fac-8eed667535d2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.241156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.243805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.244297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.244741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.246184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.246704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.250168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a14ba-4254-45db-9546-d62c1f68aa4c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.273258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 375/747] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.284238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.298758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e5e2b-7624-4cb4-aea2-e5c022eb4ad7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.306899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.307687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.308024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.308307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.309196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8bd4fc72719c45568c1a2018a1457e42) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.309520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.311489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f468-820a-4138-bce9-bda2dc0e29ad admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.319428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf1a8-7567-4726-95ec-57345cd92e50 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.319823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf1a8-7567-4726-95ec-57345cd92e50 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.320765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf1a8-7567-4726-95ec-57345cd92e50 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.321159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 373/748] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/role_assignments?user.id=8bd4fc72719c45568c1a2018a1457e42&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.323054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 376/749] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:02.329770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4f71-f6b9-4d7e-a8a0-427b6fc90fbc None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.330063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4f71-f6b9-4d7e-a8a0-427b6fc90fbc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.330343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4f71-f6b9-4d7e-a8a0-427b6fc90fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.359757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-231a4f71-f6b9-4d7e-a8a0-427b6fc90fbc None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:02.361928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-231a4f71-f6b9-4d7e-a8a0-427b6fc90fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:02.373663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 374/750] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:02 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:02.400250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf1a8-7567-4726-95ec-57345cd92e50 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.415042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf1a8-7567-4726-95ec-57345cd92e50 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.420879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.422157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.422716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.423200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.437269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:02.441607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c0ed-a6b8-4575-bb50-592cfe638f5d None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.441898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c0ed-a6b8-4575-bb50-592cfe638f5d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.442209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c0ed-a6b8-4575-bb50-592cfe638f5d None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.444293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 375/751] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:02.447158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:02.448704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 377/752] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:02.453149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.453149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.453149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.456333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.467547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534087cd-fe9f-4d1b-a99a-74a0b2215258 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.472581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:02.472965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.473864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.473996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:02.474452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.474956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.475911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.476606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.478882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.483350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 376/753] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:02 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:02.490375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 378/754] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:02.499121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.510227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c7db1-5910-423b-9f9b-85b4f281c0a0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.510637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.519992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.520993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.521366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.521757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.523485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb19b0-f46a-4e35-a3ca-a835286f0d36 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.530809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.532389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.533027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.533489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.534405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.536256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.536378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.538218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.549792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 03:45:02.551734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 379/755] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:02.557777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:02.559367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 377/756] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:02.559889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.566543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.571220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb543f68-862b-4cf9-a284-dc1a6976c6be admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.580021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.580381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.580621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.580857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.581561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.581875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.583603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.588617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab02ae-504e-4f5b-aeb9-58882bab45e2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.589981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 380/757] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.596790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.600674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.601918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.602473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.603004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.604509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.605098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.607417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5197-9f1e-4dba-83cd-f8861000855d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.608276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.612002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.612780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.613278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.613616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.614650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.614969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.616639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.622860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 381/758] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.631329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 378/759] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.639963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.659107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e176dfa-ec6f-40b9-a041-1bb4cbfb32e6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.668706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.670516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.671033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.671599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.687968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.692469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.720270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:45:02.723087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 382/760] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:02.730232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.741296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6e944-ebce-4809-85b9-da9d06315f47 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.747435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.748520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.749054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.749525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.750696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.751254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.753516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.776151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 379/761] 10.222.0.73 () {56 vars in 1157 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.783128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.794996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6d675-ea10-4a72-b981-8e89ed22a423 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.800425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.801482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.802072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.802548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.814092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.815963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.827933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 383/762] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:02.834335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.845887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2749-8a61-4e61-b9ea-127bc2bd168b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.853899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.855155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.855794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.856267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.868561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.870907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.891620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-1013a74c-9a4f-4613-902a-7bf63fd531f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:02.893815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 380/763] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:02.900553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.906962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee130a9-01f6-418c-b4dc-6d8221c74a3e None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.907253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee130a9-01f6-418c-b4dc-6d8221c74a3e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.907539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee130a9-01f6-418c-b4dc-6d8221c74a3e None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.909622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 381/764] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:02.912449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ba89-fa72-476c-96fd-56cb98a5575f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.915818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.916108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.916654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.918553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.919598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.920242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.920711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.921754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:02.922258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.925282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.936410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:02.937669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:02.940834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 384/765] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:02.948083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.951974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 382/766] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:02 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:02.959039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b9f3f-bd35-48da-a78f-4ac7016b09fe admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:02.964695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:02.965813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:02.966304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:02.966832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:02.975322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:02.979117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:02.985237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:02.997699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:03.005314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 385/767] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:03.007451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:03.008538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c8d0e-41ee-444e-9319-084b8fef6e40 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:03.013663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a341be-5170-457c-b3b4-9e7c286fbe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:03.014453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a341be-5170-457c-b3b4-9e7c286fbe79 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:03.014778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a341be-5170-457c-b3b4-9e7c286fbe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:03.015102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a341be-5170-457c-b3b4-9e7c286fbe79 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:03.015852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a341be-5170-457c-b3b4-9e7c286fbe79 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:03.017531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a341be-5170-457c-b3b4-9e7c286fbe79 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:03.021308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812b3e-5007-41bb-873e-358e55f2d6c2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:03.026988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:03.027810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:03.028167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:03.028563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:03.029459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:03.029846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:03.031820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:03.048073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 386/768] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:03.054483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:03.064771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d906-722a-4848-adbd-bee6e3e1ab4e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:03.069248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:03.069899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:03.070236 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:03.070674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:03.071517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8946263bd74d445f81944be54ef96070) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:03.071828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:03.077713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796313cf-5a39-4d1d-a7d5-66f34fe795bd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:03.080154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 387/769] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:03 2021] GET /identity/v3/role_assignments?user.id=8946263bd74d445f81944be54ef96070&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:03.108861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 383/770] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:02 2021] POST /identity/v3/services => generated 269 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:04.754595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6282f-4d64-4313-ad87-b30f4af3213e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.755135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6282f-4d64-4313-ad87-b30f4af3213e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.755135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6282f-4d64-4313-ad87-b30f4af3213e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.757236 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 388/771] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:04.763673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.764159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.764232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.783072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:04.784263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:04.803413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 384/772] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:04.828700 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6282f-4d64-4313-ad87-b30f4af3213e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:04.842784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6282f-4d64-4313-ad87-b30f4af3213e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:04.847886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:04.849044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.849506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.849952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.864030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:04.872923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:45:04.876306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 389/773] 10.222.0.73 () {56 vars in 1142 bytes} [Fri Aug 27 03:45:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:04.883720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:04.893709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909ef3-60c6-4ec7-87ef-6080c9777b13 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:04.899245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:04.900240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.900693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.901191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.902123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:04.902631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:04.905559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305193-e30a-49b9-a7a3-00ca9adf87d1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:04.916570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 385/774] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:04.923140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:04.932626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a512a3-89a8-4899-bcdd-0435908ae24b None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.932954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a512a3-89a8-4899-bcdd-0435908ae24b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.933347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a512a3-89a8-4899-bcdd-0435908ae24b None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.935882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 386/775] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:04.939092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9766-f02a-453c-922b-35f65ac4df8e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:04.942178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.942540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.942923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.945919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:04.946962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:04.947418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:04.947863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:04.958890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:04.961657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:04.963434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:04.964855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:04.982871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 387/776] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:04.986163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:04.987925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 390/777] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:04.994350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.004263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b9072-e748-4fae-a578-f91fcdc1a90c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.006917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.010727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.011408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.011690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.011964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.012703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.013008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.015496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.018766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fc896-fb33-45ec-a10a-e45b8463b9c5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.024383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.025333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.025811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.026280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.027232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.029023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.029488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 388/778] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.036922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.048518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ea594-a9d8-4a1d-87fa-9f5a68c765b9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.052989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.053799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.054379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.054379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.064071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.066091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.080948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:45:05.082343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 389/779] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:05.088793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.105061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 391/780] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:05 2021] POST /identity/v3/services => generated 251 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:05.106424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080499e-afec-4c18-afb2-2292612fd66c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.128635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.129463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.129755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.130031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.131037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.131466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.134435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.155814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 390/781] 10.222.0.73 () {56 vars in 1171 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:05.162712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.174833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158bf6-5cb4-49b5-9d3f-6438a92f22ff admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.180361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.181204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.181490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.181867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.191527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.193459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.204499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 392/782] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/auth/tokens => generated 1816 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:05.211204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.221858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632fa4-54cc-46af-95a4-1a35f77d504d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.227693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.228511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.228790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.229065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.240606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.243239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.263002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:05.264502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 391/783] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:05.270923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.282305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138353-2216-4ff0-bd5e-cf6837a9baee admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.287769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.288874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.289964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.290575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.291795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.292338 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.294247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.309677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 393/784] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.316517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.328261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1667b6-f912-4a02-900e-b3267f8a4d10 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.333485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.334751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.335246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.335759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.344629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.347070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.362151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-bc6daa33-8b09-439b-8df3-563754b73017 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:05.364069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 392/785] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:05.371027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.385730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7b33f-3ba4-4496-94dc-b8d7b9686325 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.390878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.391866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.392354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.392831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.393844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.394357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.396468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.399436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4cc68-e682-445f-9a6a-2b32912cd1d1 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.399725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4cc68-e682-445f-9a6a-2b32912cd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.400006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4cc68-e682-445f-9a6a-2b32912cd1d1 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.402124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 393/786] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:05.408398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.409126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.409126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.413287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 394/787] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.421078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.432900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97948d-adee-4d0d-ac32-417ee0041107 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.436511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:05.437954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:05.438722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.439775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.440298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.440856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.442043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] RBAC: Adding query filter params (role.id=78ee25a54d164663a763cefedde9e9fe, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8bd4fc72719c45568c1a2018a1457e42) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.442576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.444937 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.452127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 395/789] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/role_assignments?user.id=8bd4fc72719c45568c1a2018a1457e42&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=78ee25a54d164663a763cefedde9e9fe => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:05.452284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 394/789] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:05 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:05.473711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.485253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a954057-8ae5-41bb-82fa-00f658e37feb None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.490175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.491050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.491337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.491637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.493507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.495272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.507872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:45:05.514818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 395/790] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:05.517694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.530083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cd0d-8c88-4312-a31a-0fa920460e27 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.535172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.535940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.536229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.536557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.537302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.537615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.540751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d883480-141a-4395-bdf0-ee61240ed0c9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.550726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 396/791] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.553906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.565504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95edb-e48f-4b1f-96fb-35c4d12401bd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.571285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.571984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.572266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.572593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.573326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.573635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.575465 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f77e1-7034-437a-8751-4f3f22ada353 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.587275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 396/792] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.590602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40371-72b3-43ef-9f7b-13cdce980d43 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.590894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40371-72b3-43ef-9f7b-13cdce980d43 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.591166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b40371-72b3-43ef-9f7b-13cdce980d43 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.593513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 397/793] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:05.600039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.600326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.600612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.626633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:05.628001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:05.639528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 397/794] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:05 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:05.671923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40371-72b3-43ef-9f7b-13cdce980d43 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.691521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b40371-72b3-43ef-9f7b-13cdce980d43 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.698876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.700306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.700810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.701423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.702645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.705516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.718968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 03:45:05.720516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 398/795] 10.222.0.73 () {56 vars in 1154 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:05.728387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.737876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6557bb-2f8f-4e84-bb32-49090270eee9 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.743699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.744437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.744721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.744994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.745718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.746019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.747754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.753620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 398/796] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.760989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.771643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaeafe-fd04-4024-961f-1a8439f59ae7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.776790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.777469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.777795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.778073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.778836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.779190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.781103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.788220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 399/797] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.795760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.807446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace508-8664-40d6-a0d8-8585ff4a737f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.814781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.815628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.816005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.816421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.817312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] RBAC: Adding query filter params (interface=public, service_id=cc58b1cb4c4240358cac1fa7150e1cea, region_id=RegionOne) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:05.817682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.818714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:45:05.818714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:45:05.818714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:45:05.819705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad90d1-40be-43af-87f0-957415022295 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.829178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 399/798] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/endpoints?service_id=cc58b1cb4c4240358cac1fa7150e1cea&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:05.835032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:05.846577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6546805-b02c-450d-9eec-e04157ccf52c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:05.852017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b68532-6c4c-44b0-bec1-1b296f893258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:05.852742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68532-6c4c-44b0-bec1-1b296f893258 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:05.853024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68532-6c4c-44b0-bec1-1b296f893258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:05.853299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68532-6c4c-44b0-bec1-1b296f893258 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:05.854780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b68532-6c4c-44b0-bec1-1b296f893258 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:05.856458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b68532-6c4c-44b0-bec1-1b296f893258 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:05.863585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 400/799] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:45:05 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:45:07.439175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d469-e293-4979-8f93-8a874a25d909 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.439175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d469-e293-4979-8f93-8a874a25d909 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.439175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d469-e293-4979-8f93-8a874a25d909 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.440427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 400/800] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:07.447008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.447931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.448431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.469121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:07.470752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:07.480389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 401/801] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:07.512108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d469-e293-4979-8f93-8a874a25d909 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.525279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d469-e293-4979-8f93-8a874a25d909 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.530169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.531272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.531756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.532271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.533138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:07.534977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:07.550411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 03:45:07.552378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 401/802] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:07.560333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.571949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c24b-babd-45b4-981e-f06819a20d98 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.578903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.579909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.580415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.580912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.581845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:07.582351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:07.584215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:07.592417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 402/803] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:07.599083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.609730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c927-23fe-4491-b349-306ce478286f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.614635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.615540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.616021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.616516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.617449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:07.617955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:07.619764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:07.625419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 402/804] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:07.632062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.643215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9713dc4-eff1-45f2-b2df-bf0b78a4d5c8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.648825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.649739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.650226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.650764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.651765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] RBAC: Adding query filter params (interface=public, service_id=a7a4a93e860144f0a64079aa7f84b722, region_id=RegionOne) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:07.652276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:07.654165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9a06-8302-4e63-8774-8da619d180a1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:07.660398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 403/805] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/endpoints?service_id=a7a4a93e860144f0a64079aa7f84b722&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:07.667126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.681607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1a2c-a531-4cc6-b8e7-7694d0b8c264 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.689641 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940c87-0747-4eb9-9963-a2a6b8f9d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.690656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940c87-0747-4eb9-9963-a2a6b8f9d55e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.691167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940c87-0747-4eb9-9963-a2a6b8f9d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.691640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940c87-0747-4eb9-9963-a2a6b8f9d55e admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.692525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa940c87-0747-4eb9-9963-a2a6b8f9d55e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:07.694324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa940c87-0747-4eb9-9963-a2a6b8f9d55e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:07.702045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 403/806] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/services => generated 1268 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:45:07.853708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc6c4c-2345-48c4-a725-e40c5001df7e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.854131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc6c4c-2345-48c4-a725-e40c5001df7e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.854310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc6c4c-2345-48c4-a725-e40c5001df7e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.856668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 404/807] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:07.863772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923b49-cd73-4974-8e74-1e70eb7c346d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.864094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923b49-cd73-4974-8e74-1e70eb7c346d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.864350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54923b49-cd73-4974-8e74-1e70eb7c346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.886875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-54923b49-cd73-4974-8e74-1e70eb7c346d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:07.895042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-54923b49-cd73-4974-8e74-1e70eb7c346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:07.902693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 404/808] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:07.922733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc6c4c-2345-48c4-a725-e40c5001df7e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.937018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc6c4c-2345-48c4-a725-e40c5001df7e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.942201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.943750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.944329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.944641 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915737-fea4-44a9-b363-218a3538af26 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.945746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.945941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915737-fea4-44a9-b363-218a3538af26 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.946475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915737-fea4-44a9-b363-218a3538af26 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.948535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 405/809] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:07.954960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.955259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.955544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:07.958740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:07.968234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:45:07.970335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 405/810] 10.222.0.73 () {56 vars in 1142 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:07.981127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:07.981496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:07.982829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:07.993005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308e3a-eb04-4f16-a00b-980d58d3fdf2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:07.998112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:07.998674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 406/811] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:07.998857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:07.999145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:07.999422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.004701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.004701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.004701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.011934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 406/812] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:08.017495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.018838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.035233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe024e-5263-43a9-af36-fc84b9f74d97 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.037034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3bbf-03b3-480b-91ce-2e6f4ba6c3e7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.043630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.044417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.044702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.045203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.046020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.046273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.047175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.047464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.047719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.047819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.061014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.063010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.083282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:08.084557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 407/813] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:08.091808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.103001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847954ac-b0c9-4996-b28f-b5c217b4e472 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.107798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.108553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.108877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.109032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.109778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.110083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.111758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.124882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 408/814] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:08.133893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.145107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684eb8b-eaeb-46bd-9df2-32febdf66162 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.151129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.155296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.155296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.155296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.162470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.165966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.182102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-ed2b8e17-34f8-479e-b227-b3c4192ec62e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:45:08.183464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 409/815] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:08.185890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84a5b-02b5-4c23-9ddc-c55168cd9d97 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.186178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84a5b-02b5-4c23-9ddc-c55168cd9d97 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.186455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd84a5b-02b5-4c23-9ddc-c55168cd9d97 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.188904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 410/816] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:08.190621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84a5b-02b5-4c23-9ddc-c55168cd9d97 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.203763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd84a5b-02b5-4c23-9ddc-c55168cd9d97 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.208315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.208973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.209256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.209528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.210365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.211296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.214036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda90fe-45aa-4dd5-a043-c574764c4b99 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.231668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 411/817] 10.222.0.73 () {56 vars in 1171 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:08.232958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.233247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.233524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.248075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 407/818] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:08 2021] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:08.248799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.262620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:08.262620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:08.271665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e83110-7048-4b35-8c84-940b66af7eb1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.282166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 412/819] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:08 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:08.283393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.284562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.285056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.285838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.301156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.303738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.310828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.322216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca97bd3-0263-48a9-acca-6dfbcd214e3f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.327120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.327963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.328231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.328510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.328787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:08.329168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.330502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 408/820] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:08.330832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.343530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 03:45:08.343870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.344932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 413/821] 10.222.0.73 () {56 vars in 1154 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:08.352130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.361707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd56a4-330c-4cbb-a6b3-e7154fff80a9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.363531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc775-3759-47da-ac58-e83f76cef34e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.368324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.369502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.369644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.370185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.370392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.370490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.370783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.371217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.371515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.371823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.372599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.373229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.373460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.376092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.385739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 414/822] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:08.387615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.397763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 409/823] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:08.399383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.408914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7b14-d19b-42d3-96d9-8fa39d69d789 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.415453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2271c-952d-4333-b5f4-039b1ddc1ebe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.419906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.420832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.421113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.421383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.422091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.423394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.423499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.424094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.425111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.425291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.425527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.431651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 415/824] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:08.436510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.438586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.438802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.449007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b995-27c6-4cab-8dd3-1fd30532a7f0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.453637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c89250-9655-4aae-a8f3-d91c504eaf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.454347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89250-9655-4aae-a8f3-d91c504eaf41 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.454614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89250-9655-4aae-a8f3-d91c504eaf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.454913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89250-9655-4aae-a8f3-d91c504eaf41 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.455007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:08.455657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c89250-9655-4aae-a8f3-d91c504eaf41 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.456195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 410/825] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:08.459646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c89250-9655-4aae-a8f3-d91c504eaf41 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.463336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.473992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4acf9-99dc-4419-a85c-e5d8f45b764a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.479324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.483295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.483295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.483295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.483295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:08.483295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.484090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.497591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 411/826] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:08.504354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:08.514379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985dfb-5fb0-4b09-902f-10b6eff08652 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:08.521023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101dc47-946f-452b-8606-616121f0b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:08.521863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101dc47-946f-452b-8606-616121f0b0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:08.522193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101dc47-946f-452b-8606-616121f0b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:08.522483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101dc47-946f-452b-8606-616121f0b0b3 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/8bd4fc72719c45568c1a2018a1457e42/roles/78ee25a54d164663a763cefedde9e9fe` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:08.526360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101dc47-946f-452b-8606-616121f0b0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=8bd4fc72719c45568c1a2018a1457e42, role_id=78ee25a54d164663a763cefedde9e9fe)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:08.529081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101dc47-946f-452b-8606-616121f0b0b3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:08.556671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 416/827] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:08 2021] POST /identity/v3/endpoints => generated 347 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:45:08.664598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 412/828] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:45:08 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/8bd4fc72719c45568c1a2018a1457e42/roles/78ee25a54d164663a763cefedde9e9fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:45:10.096632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd6a6-c98d-417f-8817-66ca07ae994a None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.097182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd6a6-c98d-417f-8817-66ca07ae994a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.097182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd6a6-c98d-417f-8817-66ca07ae994a None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.099239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 417/829] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:10.105757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.106227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.106304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.125528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:10.126786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:10.205951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 413/830] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:10.231696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd6a6-c98d-417f-8817-66ca07ae994a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.244333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd6a6-c98d-417f-8817-66ca07ae994a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.249064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.249876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.250156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.250428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.251128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.252736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.264222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 03:45:10.265747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 418/831] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:10.272486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.282618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a604-6036-459e-98f4-c1b811f8ac00 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.287324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.288002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.288284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.289447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.290185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:10.290492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.292399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.298102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 414/832] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:10.304699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.315218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc5390-245a-4111-a3d5-d29ec6e38937 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.320040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.320831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.321074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.321347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.322063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:10.322362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.323989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166284dc-4812-41ef-ad7e-7e1b0b8eaa58 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.329768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 419/833] 10.222.0.73 () {56 vars in 1136 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:10.336850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.346867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a455910-9f1a-4350-809e-405f9c5568fd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.352497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9ba03-45ef-4258-b30c-26e3819cc57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.353588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ba03-45ef-4258-b30c-26e3819cc57e admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.354050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ba03-45ef-4258-b30c-26e3819cc57e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.354528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ba03-45ef-4258-b30c-26e3819cc57e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.355472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9ba03-45ef-4258-b30c-26e3819cc57e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.357092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9ba03-45ef-4258-b30c-26e3819cc57e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.456241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 415/834] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:10 2021] POST /identity/v3/endpoints => generated 346 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:45:10.603382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff084-a5ee-4659-94a7-aedf42cb4bce None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.603744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff084-a5ee-4659-94a7-aedf42cb4bce None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.604244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff084-a5ee-4659-94a7-aedf42cb4bce None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.607037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 420/835] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:10.623659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.623996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.624222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.643404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:10.644693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:10.663334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 416/836] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:10 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:10.688918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff084-a5ee-4659-94a7-aedf42cb4bce None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.702872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff084-a5ee-4659-94a7-aedf42cb4bce None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.708817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.709865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.710358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.710863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.711705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.713526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.725811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:45:10.728445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 421/837] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:10.735535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.746031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6672-8c83-4620-a0f9-7d47b1d497ce None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.751088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.752032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.752494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.752966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.753856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:10.754351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.756208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.765107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 417/838] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:10.772435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.784364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713b8b-1f4c-487a-9675-71eaf70eea88 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.790415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.791796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.792265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.792763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.793770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:10.794340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.796301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.803165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 422/839] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:10.810604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.822554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d6ff6-5385-46bc-8268-3ceb4f356943 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.828320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.829400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.829893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.830347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.831416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] RBAC: Adding query filter params (interface=public, service_id=7c59f1d24ab44bd2a263357bc0d5588f, region_id=RegionOne) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:10.831982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.833907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5dfc2-8a54-4b93-8930-d962594a8369 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.841313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 418/840] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/endpoints?service_id=7c59f1d24ab44bd2a263357bc0d5588f&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:10.848039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.860230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4162444-93d8-47bd-a2d1-9e024d29ff47 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.865580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836cb8f-b9e5-419f-9d58-a752ab25edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.866499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836cb8f-b9e5-419f-9d58-a752ab25edc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.867640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836cb8f-b9e5-419f-9d58-a752ab25edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.868304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836cb8f-b9e5-419f-9d58-a752ab25edc6 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.869255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836cb8f-b9e5-419f-9d58-a752ab25edc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.871432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836cb8f-b9e5-419f-9d58-a752ab25edc6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:10.879359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 423/841] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services => generated 1497 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:45:10.887117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390bf68-ef82-42bd-8a98-5f07d320de95 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.887730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390bf68-ef82-42bd-8a98-5f07d320de95 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.888284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390bf68-ef82-42bd-8a98-5f07d320de95 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.890872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 419/842] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:10.897396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c94f5-6817-4ab7-aae6-3e25d48f6755 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.897685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c94f5-6817-4ab7-aae6-3e25d48f6755 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.898393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c94f5-6817-4ab7-aae6-3e25d48f6755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.919115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-068c94f5-6817-4ab7-aae6-3e25d48f6755 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:10.920366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-068c94f5-6817-4ab7-aae6-3e25d48f6755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:10.934707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 424/843] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:10 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:10.954572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390bf68-ef82-42bd-8a98-5f07d320de95 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:10.965973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479dbf-bf6d-4cbb-bc77-9056f575b7b4 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.966324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479dbf-bf6d-4cbb-bc77-9056f575b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.966596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479dbf-bf6d-4cbb-bc77-9056f575b7b4 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.968925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 425/844] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:10.971410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390bf68-ef82-42bd-8a98-5f07d320de95 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:10.976610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.977947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.978593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.984365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:10.985275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:10.985563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:10.985844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:10.986585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:10.988303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.007096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 03:45:11.009149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:11.010008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 420/845] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:10 2021] GET /identity/v3/services/compute => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:11.014620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:11.022321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 426/846] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:10 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:11.023481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.035229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b5519-17c3-4d17-8400-e4ce1e223f49 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.041054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.042336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.042805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.043246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.044176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.044642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.046649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.049889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.066005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae93a8-7c59-4a22-9586-b36d56f93f92 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.068039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 421/847] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:11.073675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.075353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.076043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.076825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.077412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.086717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab0b3f-b5f7-4beb-b8a0-a2ee1e3637df admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.094430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.099276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.099276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.099276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.099276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.099585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:11.100003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.100003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.105592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 422/848] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:11.105868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:45:11.107415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 427/849] 10.222.0.73 () {56 vars in 1142 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:11.115863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.127394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc055c3c-f751-428a-8e20-d2ca6d0e5577 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.133406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.134301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.134673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.134951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.135911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.136224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.137997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.149765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 423/850] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:11.156445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.168782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea504-b3e0-4964-a133-cb82bb2265c0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.174659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.175536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.175864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.176136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.188977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.190974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.212189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:11.213792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 428/851] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:11.220203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.231293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6fe52-6062-4a53-9036-7ea5b13ae289 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.236124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.236885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.237233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.237576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.238383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.238782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.240506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.254340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 424/852] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:11.261188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.271597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3e663-4e04-4ef3-9532-808d547f86db admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.277067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.277899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.278177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.278450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.288035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.290239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.305602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:45:11.307141 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 429/853] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:11.313698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.324769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cba1ce-5d05-49d3-8338-7f33c3e12c8e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.330798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.331525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.331809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.332076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.332921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.333227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.335097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.355339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 425/854] 10.222.0.73 () {56 vars in 1171 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:11.361853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.372044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2616-c67b-47e9-81b1-4f87f2cb01c3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.376502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.377177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.377438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.377710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.387044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.388805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.399697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 430/855] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:11.406067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.419404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4bcf5-8016-4ec4-8377-74d5b602e63b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.424614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.425434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.425707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.425982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.438276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.440184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.458444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:11.459694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 426/856] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:11.466249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.477256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cdd46-9c7a-4484-973f-34a876cda3b1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.482513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.483226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.483505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.483779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.484504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.484805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.486502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.500569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 431/857] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:11.507115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.517750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0529e9-decc-4dab-b874-3ee69c7a8c62 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.522549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.524033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.524312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.524580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.532091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.534145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.548610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:11.549879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 427/858] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:11.556707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.567184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ebec7-affd-4bc5-a91f-667add33c7aa admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.572032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.572793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.573074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.573344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.574182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.574491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.576586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb56bc-ec90-47f3-a6d8-2049370f39a9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.594661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 432/859] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:11.597078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:11.608970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f36d-7b33-42da-b8cd-813ebbf6902e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:11.613908 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:11.614594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:11.614881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:11.615207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:11.616033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] RBAC: Adding query filter params (role.id=78ee25a54d164663a763cefedde9e9fe, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=8bd4fc72719c45568c1a2018a1457e42) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:11.616394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:11.619136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda0b9a-84fe-4e0d-b93e-4eb28186fb1b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:11.630118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 428/860] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:11 2021] GET /identity/v3/role_assignments?user.id=8bd4fc72719c45568c1a2018a1457e42&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=78ee25a54d164663a763cefedde9e9fe => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:12.818321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d649a2-1aed-4872-ae98-b4a770408205 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:12.819065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d649a2-1aed-4872-ae98-b4a770408205 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:12.819065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d649a2-1aed-4872-ae98-b4a770408205 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:12.821574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 433/861] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:12.828264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:12.828851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:12.828851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:12.847969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:12.849189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:12.858111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 429/862] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:12 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:12.884609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d649a2-1aed-4872-ae98-b4a770408205 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:12.897241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d649a2-1aed-4872-ae98-b4a770408205 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:12.902684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:12.903355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:12.903642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:12.903924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:12.904646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:12.906510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:12.908099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.common [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 03:45:12.966628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.sql.core [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 03:45:12.966628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 03:45:12.966628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [parameters: {'id': 'cc545279e196486281a7fe484d8b57ce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 03:45:12.966628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73793) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 03:45:12.973364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc545279e196486281a7fe484d8b57ce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc545279e196486281a7fe484d8b57ce. Aug 27 03:45:12.975093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 434/863] 10.222.0.73 () {60 vars in 1162 bytes} [Fri Aug 27 03:45:12 2021] POST /identity/v3/projects => generated 262 bytes in 91 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:12.983255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:12.993913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7fbba-bc9b-44cb-9a7c-e12c3671fbfc None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.003806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.004847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.005133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.005412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.013264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.015355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.029918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-f3598436-65ed-4760-b3be-652f6527c3dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:13.031583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 430/864] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:13.037918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:13.050611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2801-3b9a-455b-92fd-0b7c33384bf8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.055551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.056320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.056607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.056884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.057707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:13.058017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.060383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5e7e-3e35-4162-b625-48320d240b12 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.085017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 435/865] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:13 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:13.229398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654b61f-5f1e-4cf3-8b56-4c2813148449 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.229773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654b61f-5f1e-4cf3-8b56-4c2813148449 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.229976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654b61f-5f1e-4cf3-8b56-4c2813148449 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.232135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 431/866] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:13.238749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.239332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.239807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.260073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:13.262081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:13.270909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 436/867] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:13 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:13.301020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654b61f-5f1e-4cf3-8b56-4c2813148449 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:13.314823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654b61f-5f1e-4cf3-8b56-4c2813148449 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.321427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.322236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.322511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.322804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.323473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.325067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.342591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:45:13.344089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 432/868] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:13 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:13.352540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:13.362730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08811098-7a1a-47e3-8d8e-b013308a5fc1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.368175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.369136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.369565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.369982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.370892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:13.371438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.373355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.379777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 437/869] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:13 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:13.387481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:13.398830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc666ae-289c-41a2-83ff-c5989a98a217 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.403962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.404894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.405325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.405773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.406724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:13.407196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.409054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac4d1-5356-4a2a-bcf0-ab7634c235dd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.416053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 433/870] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:13 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:13.422938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:13.434220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00026993-4dbe-4ded-9a78-47f44d30bc77 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.437376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b61ee-5652-46b9-ada2-d7cb86872d3e None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.438057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b61ee-5652-46b9-ada2-d7cb86872d3e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.438580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b61ee-5652-46b9-ada2-d7cb86872d3e None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.441378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 434/871] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:13.441494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecdef8-4c7c-4e83-8e41-5ff925257366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.442108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecdef8-4c7c-4e83-8e41-5ff925257366 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.442393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecdef8-4c7c-4e83-8e41-5ff925257366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.446728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecdef8-4c7c-4e83-8e41-5ff925257366 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.446728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecdef8-4c7c-4e83-8e41-5ff925257366 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.446728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecdef8-4c7c-4e83-8e41-5ff925257366 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.448687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.449072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.449449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.467886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:13.469195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:13.478028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 435/872] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:13 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:13.502171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:13.511696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31964a-6de3-42e6-96ab-acefac43c755 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:13.516502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20f50b-9a18-4f23-9292-fc16a9517f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:13.517190 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20f50b-9a18-4f23-9292-fc16a9517f44 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.517472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20f50b-9a18-4f23-9292-fc16a9517f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.517752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20f50b-9a18-4f23-9292-fc16a9517f44 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:13.518494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20f50b-9a18-4f23-9292-fc16a9517f44 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:13.520226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20f50b-9a18-4f23-9292-fc16a9517f44 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:13.539718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 438/873] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:13 2021] POST /identity/v3/endpoints => generated 349 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:13.597689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 436/874] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:13 2021] POST /identity/v3/services => generated 242 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:13.997242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c07e8-3875-4979-ae42-74d6c137e099 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:13.998128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c07e8-3875-4979-ae42-74d6c137e099 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:13.998663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c07e8-3875-4979-ae42-74d6c137e099 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:14.000905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 439/875] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:14.006805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392dc88-20c5-4542-8325-6039544b950c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:14.007920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392dc88-20c5-4542-8325-6039544b950c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:14.008019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392dc88-20c5-4542-8325-6039544b950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:14.026940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4392dc88-20c5-4542-8325-6039544b950c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:14.028149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4392dc88-20c5-4542-8325-6039544b950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:14.050705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 437/876] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:14 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:14.072583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c07e8-3875-4979-ae42-74d6c137e099 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:14.088290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c07e8-3875-4979-ae42-74d6c137e099 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:14.092941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:14.093734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:14.094018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:14.094297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] PATH_INFO: `/v3/services/image` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:14.094990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:14.096587 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:14.108757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 03:45:14.114671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 440/877] 10.222.0.73 () {56 vars in 1127 bytes} [Fri Aug 27 03:45:14 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:14.118156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392dc88-20c5-4542-8325-6039544b950c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:14.127571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392dc88-20c5-4542-8325-6039544b950c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:14.132948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:14.133729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:14.134021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:14.134303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:14.135070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:14.135380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:14.137001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad27a-3cb6-4729-9e0a-c9437f9d1df0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:14.144392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 438/878] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:14 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:14.153221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:14.168841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74356e-c034-44a8-94dd-7f68718b77cf admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:14.174870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:14.175585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:14.175870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:14.176228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:14.176944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] RBAC: Adding query filter params (type=image) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:14.177299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:14.178987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c53b72-bbb6-4ab3-b347-fb447710c0da admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:14.184431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 441/879] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:14 2021] GET /identity/v3/services?type=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:15.450548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e7888-036b-4912-987c-84ac50ac7ae9 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.451115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e7888-036b-4912-987c-84ac50ac7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.451115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e7888-036b-4912-987c-84ac50ac7ae9 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.452936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 439/880] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:15.459586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.460118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.461027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.482685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:15.484564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:15.493877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 442/881] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:15.523062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e7888-036b-4912-987c-84ac50ac7ae9 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:15.536183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e7888-036b-4912-987c-84ac50ac7ae9 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:15.541566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:15.542247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.542530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.542843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.543561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:15.545420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:15.546901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.common [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 03:45:15.620464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.sql.core [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 03:45:15.620464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 03:45:15.620464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [parameters: {'user_id': '1df09f3f121b4648bc2fe643a8fc54db', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 03:45:15.620464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73792) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 03:45:15.638927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 03:45:15.646021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 440/882] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 03:45:15 2021] POST /identity/v3/users => generated 160 bytes in 118 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:15.647481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:15.657952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0b2c-2a63-46c6-baa4-27eae784e531 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:15.663030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:15.665140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.665428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.665710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.674728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:15.676856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:15.693926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-05fb4c4e-ea2a-46cf-a3b2-a702d1762ff7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:45:15.700817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 443/883] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:15 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:15.704093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:15.718915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed275efa-513e-4c6c-9532-26676c8fc3ab admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:15.723717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:15.724398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.724683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.724961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.726350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:15.727417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:15.729706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b051e7-b783-4979-8701-6acb4d9f25f3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:15.776144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 441/884] 10.222.0.73 () {56 vars in 1123 bytes} [Fri Aug 27 03:45:15 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:15.903195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c71d0b-fc05-4650-ade2-5f0cff4388d9 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.903195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c71d0b-fc05-4650-ade2-5f0cff4388d9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.903195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c71d0b-fc05-4650-ade2-5f0cff4388d9 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.904092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 444/885] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:15.911236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.911863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.913048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.930982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b6a3-9dd9-4705-bb24-ed9f55e11d0e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.931306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b6a3-9dd9-4705-bb24-ed9f55e11d0e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.931561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b6a3-9dd9-4705-bb24-ed9f55e11d0e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.933692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 445/886] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:15.939665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:15.940124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.940414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.940692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.941301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:15.951400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 442/887] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:15.960373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:15.961614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:15.969969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 446/888] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:15.977395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:15.988471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a843c4-b9e5-4b1a-9b57-8bd1914289e3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:15.996938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:15.998161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:15.998337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:15.998445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:15.998771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:15.999430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.001044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.009156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd00da0-ddc5-47c5-b537-25755c61ebea None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.014512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.015073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:45:16.015351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.015715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.016180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.022194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 443/889] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:16.022356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.022356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.024079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.033877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135588-4222-4a01-a440-510320c9bf23 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.036058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 03:45:16.037892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 447/890] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:15 2021] GET /identity/v3/services/compute => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:16.040192 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.040902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.041444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.041715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.042432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:16.042762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.044367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.049214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.052271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 444/891] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:16.059623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.062376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da036bc-5b4d-42bb-84d2-b11ec1420e66 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.068787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.069842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.070140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.070401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885f776-6667-4703-90ef-4795311dbf44 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.070501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.071185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:16.071572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.073105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.076019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.076722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.076974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.077823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.077957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:16.078263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.080336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 448/892] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:16.082346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.088013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.089940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 445/893] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:16.094911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.105900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2edc22-e9d4-44b0-aa94-74342a89e5fa admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.110900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eab3d-2ecf-43c4-92f7-2bf34b3361ee admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.111055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.111642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.111980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.112250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.113244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:16.113527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.115184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.121410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.122090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.125522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.125522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.125522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] RBAC: Adding query filter params (interface=admin, service_id=7c59f1d24ab44bd2a263357bc0d5588f, region_id=RegionOne) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:16.125522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.125846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 449/894] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:16.125938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.131626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 446/895] 10.222.0.73 () {56 vars in 1271 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/endpoints?service_id=7c59f1d24ab44bd2a263357bc0d5588f&interface=admin®ion_id=RegionOne => generated 193 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:16.133848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.140353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.144636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb76da-8d1e-4522-acdf-39790e63f4c3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.151518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.152198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.152483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.152758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.153220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8aa9c-952a-4e86-9c10-da91f49a2cbe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.153561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] RBAC: Adding query filter params (interface=public, service_id=b7269441d2f0485bbb8b503219453724, region_id=RegionOne) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:16.153878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.155508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.157831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedb51-dad5-4921-a6bd-8d9bc36380b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.158512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedb51-dad5-4921-a6bd-8d9bc36380b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.158826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedb51-dad5-4921-a6bd-8d9bc36380b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.159104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedb51-dad5-4921-a6bd-8d9bc36380b9 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.159793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedb51-dad5-4921-a6bd-8d9bc36380b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.161407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedb51-dad5-4921-a6bd-8d9bc36380b9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.162847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 450/896] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/endpoints?service_id=b7269441d2f0485bbb8b503219453724&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:16.169441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.174626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 447/897] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/services => generated 1727 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:45:16.182998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39dba5-e266-4e66-8589-373132628772 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.188010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe192d-f802-4244-9c4d-3c6109a04b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.188703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe192d-f802-4244-9c4d-3c6109a04b22 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.188986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe192d-f802-4244-9c4d-3c6109a04b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.189263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe192d-f802-4244-9c4d-3c6109a04b22 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.189969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe192d-f802-4244-9c4d-3c6109a04b22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.191687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe192d-f802-4244-9c4d-3c6109a04b22 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.199625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 451/898] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:45:16 2021] GET /identity/v3/services => generated 1727 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:45:16.482184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94ef4f-1285-4d03-9b75-3fe589c9558d None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.482738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94ef4f-1285-4d03-9b75-3fe589c9558d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.482813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94ef4f-1285-4d03-9b75-3fe589c9558d None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.484697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 448/899] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:16.490832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b1bb-760b-4025-984a-af3904a44b05 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.491393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b1bb-760b-4025-984a-af3904a44b05 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.491393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b1bb-760b-4025-984a-af3904a44b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.510514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-daf5b1bb-760b-4025-984a-af3904a44b05 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:16.511757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-daf5b1bb-760b-4025-984a-af3904a44b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:16.520081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 452/900] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:16 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:16.545101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94ef4f-1285-4d03-9b75-3fe589c9558d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:16.559854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94ef4f-1285-4d03-9b75-3fe589c9558d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:16.564325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225730-faca-4657-bd8a-92057295007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:16.564994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225730-faca-4657-bd8a-92057295007f admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:16.565279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225730-faca-4657-bd8a-92057295007f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:16.565558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225730-faca-4657-bd8a-92057295007f admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:16.566302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7225730-faca-4657-bd8a-92057295007f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:16.568051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7225730-faca-4657-bd8a-92057295007f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:16.644724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 449/901] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:16 2021] POST /identity/v3/services => generated 242 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:18.430396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385fa2-c1e4-40d6-8b2a-35c5bedbc9cb None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.430968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385fa2-c1e4-40d6-8b2a-35c5bedbc9cb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.430968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385fa2-c1e4-40d6-8b2a-35c5bedbc9cb None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.432766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 453/902] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:18.440206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.440675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.440880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.463291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:18.464500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:18.472097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381d5a-e0ae-493d-b9c4-be302ab22124 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.472383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381d5a-e0ae-493d-b9c4-be302ab22124 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.472667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381d5a-e0ae-493d-b9c4-be302ab22124 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.474451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 454/903] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:18.481630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.481919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.482202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.488647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 450/904] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:18 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:18.505392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:18.508713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:18.515376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.518766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 455/905] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:18 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:18.525767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733ffbb-7976-41fd-8556-52bb9b168253 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.530856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.531770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.532133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.532474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.533197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.534913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.544433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.548667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:45:18.550607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 451/906] 10.222.0.73 () {56 vars in 1148 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:18.554367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7774-7b03-43c6-96f0-f25320624315 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.557553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.560744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.561542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.561822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.562094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.563316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.564372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.568125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97d9e-51c9-48ef-aedf-9bb9d28b740e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.573312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.573979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.574264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.574542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.575296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:18.575605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.575758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 03:45:18.578484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 456/907] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:18.578646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.585639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.589284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 452/908] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:18.595894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.597558 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90fc4a-553a-4a60-a85e-2077de201675 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.603734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.604412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.604697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.604973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.605688 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:18.605994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.607648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.612709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3f6f8-7c37-4c9e-aeaa-6dedf133330a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.618010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.618723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.619011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.619390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 457/909] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:18.622925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.623729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:18.624050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.625448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.625760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.631584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 453/910] 10.222.0.73 () {56 vars in 1144 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:18.638485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.641774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb0880-77ec-4a87-96a8-077b4fe5823a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.647580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.648745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153370-db64-4882-a752-d2370930f330 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.649102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.649481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.649719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.650437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:18.650776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.652401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.653523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b588223-b657-4e5d-9458-19371425a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.654175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b588223-b657-4e5d-9458-19371425a76c admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.654455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b588223-b657-4e5d-9458-19371425a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.654766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b588223-b657-4e5d-9458-19371425a76c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.655507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b588223-b657-4e5d-9458-19371425a76c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.657073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b588223-b657-4e5d-9458-19371425a76c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.659206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 458/911] 10.222.0.73 () {56 vars in 1134 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:18.664262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.677013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1c3cd-2571-422b-9df6-652506a622e2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.682903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a941-9831-42e2-bfd1-6f0bd5d0598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.683509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a941-9831-42e2-bfd1-6f0bd5d0598f admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.683796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a941-9831-42e2-bfd1-6f0bd5d0598f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.684076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a941-9831-42e2-bfd1-6f0bd5d0598f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.684819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a941-9831-42e2-bfd1-6f0bd5d0598f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.686420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a941-9831-42e2-bfd1-6f0bd5d0598f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.738424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 454/912] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:18 2021] POST /identity/v3/endpoints => generated 325 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:45:18.774047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 459/913] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:18 2021] POST /identity/v3/endpoints => generated 334 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:45:18.862107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5de4-5e28-4174-b8f1-71a208df5cf5 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.862433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5de4-5e28-4174-b8f1-71a208df5cf5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.862705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5de4-5e28-4174-b8f1-71a208df5cf5 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.864807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 455/914] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:18.871976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.872256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.872537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.895814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:18.897062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:18.919094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 460/915] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:18 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:18.943646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f5de4-5e28-4174-b8f1-71a208df5cf5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:18.958488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f5de4-5e28-4174-b8f1-71a208df5cf5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:18.964055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:18.965145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:18.965308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:18.965574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:18.966245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:18.967894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:18.981133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 03:45:18.982693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 456/916] 10.222.0.73 () {56 vars in 1127 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:18.989359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:19.000692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8b29-f1ca-4608-a948-6fa30bd7db4a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:19.005481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:19.006167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:19.006460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:19.006781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:19.008272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:19.008588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:19.010230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:19.016751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 461/917] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:18 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:19.023935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:19.035239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f327139-d0d3-4c0b-9bd3-ae01fbe3cb81 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:19.041622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:19.042585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:19.042897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:19.043157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:19.043879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:19.044195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:19.045848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:19.051988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 457/918] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:19 2021] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:19.059936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:19.071325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d140495-eef3-4dcc-8cfe-f08c00b43f26 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:19.077810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:19.078491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:19.078833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:19.079372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:19.086478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] RBAC: Adding query filter params (interface=public, service_id=dde34c9830c64d6b856580d54c54a206, region_id=RegionOne) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:19.086884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:19.088469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76639504-c9fe-464b-992a-8d6979f2efae admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:19.094699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 462/919] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:45:19 2021] GET /identity/v3/endpoints?service_id=dde34c9830c64d6b856580d54c54a206&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:19.101257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:19.112592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57a05f-a31a-4e77-9f0a-fdc21b868ee6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:19.119605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79a973-1655-4878-8b36-3b1758652d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:19.120281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a973-1655-4878-8b36-3b1758652d92 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:19.120562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a973-1655-4878-8b36-3b1758652d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:19.120834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a973-1655-4878-8b36-3b1758652d92 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:19.121517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79a973-1655-4878-8b36-3b1758652d92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:19.124697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79a973-1655-4878-8b36-3b1758652d92 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:19.132758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 458/920] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:45:19 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:45:20.984164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb340-3ae6-4511-aec0-e51b9fe81f0f None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:20.984775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb340-3ae6-4511-aec0-e51b9fe81f0f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:20.984775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb340-3ae6-4511-aec0-e51b9fe81f0f None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:20.986497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 463/921] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:20.997065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b4ef-0911-4488-8906-237647793300 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:20.997065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b4ef-0911-4488-8906-237647793300 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:20.997065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b4ef-0911-4488-8906-237647793300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.016987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2b11b4ef-0911-4488-8906-237647793300 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:21.018176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2b11b4ef-0911-4488-8906-237647793300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:21.034253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 459/922] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:20 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:21.066852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb340-3ae6-4511-aec0-e51b9fe81f0f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.083263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb340-3ae6-4511-aec0-e51b9fe81f0f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.089251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b453a65-8b7b-4d57-88c7-d32bf4a1c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.090089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453a65-8b7b-4d57-88c7-d32bf4a1c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.090368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453a65-8b7b-4d57-88c7-d32bf4a1c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.090680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b453a65-8b7b-4d57-88c7-d32bf4a1c7e2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.092012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b453a65-8b7b-4d57-88c7-d32bf4a1c7e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.094037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b453a65-8b7b-4d57-88c7-d32bf4a1c7e2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.096085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 464/923] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:21.104129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b4ef-0911-4488-8906-237647793300 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.114430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b4ef-0911-4488-8906-237647793300 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.119787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.120474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.120756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.121033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.121763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.123710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.171081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5aec-9481-4250-a7e7-5cbe9c9c3bda None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.171368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5aec-9481-4250-a7e7-5cbe9c9c3bda None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.171648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5aec-9481-4250-a7e7-5cbe9c9c3bda None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.173517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 465/924] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:21.180058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.184873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.184873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.200281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:21.202922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:21.209560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 466/925] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:21 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:21.235110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 460/926] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:21 2021] POST /identity/v3/projects => generated 311 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:21.239018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.249348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bc91-1c73-4df8-bd19-8a70ec725aa9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.312253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.313092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.313376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.313653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.328509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:21.336622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:45:21.338785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 467/927] 10.222.0.73 () {56 vars in 1142 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:21.345367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.356573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ba2e4-6f2e-46cf-9cbb-24a1cd82f039 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.361657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.362344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.362648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.362919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.363683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.363986 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.365718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d742c8-13ae-473c-b8bc-53fe1d7c3914 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.377035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 461/928] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:21.385167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.396974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c96b2-b615-4dea-908f-e2dfcdc7042f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.404178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.405000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.405283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.405561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.413664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248f47-ba20-408a-bd87-5ac6a8287777 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.413990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248f47-ba20-408a-bd87-5ac6a8287777 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.414229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248f47-ba20-408a-bd87-5ac6a8287777 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.417467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 462/929] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:45:21.419787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.421942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.423307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.423755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.424033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.440031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:21.441458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 468/930] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:21.444047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:21.445867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:21.448515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.454260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 463/931] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:21 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:21.458838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2db1-bac8-4730-99fd-a139d69557a7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.464936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.465610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.465894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.466171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.466957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.467268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.468906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.480204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.483981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 469/932] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:21.490492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae76235-2bf2-4654-8a3a-7767c3788bff None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.490670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.496095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.496903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.497186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.497992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.498109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.499774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.503359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05988-77f5-4e59-9a5e-a069ddcefdbb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.510658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.511464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.511890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.512060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.513716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 03:45:21.520411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 464/933] 10.222.0.73 () {56 vars in 1127 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:21.526007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.527464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.528415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.537107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f97985-732f-410f-bf37-8eaa6fe3b593 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.542651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.543323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.543604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.543765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:45:21.543918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.544671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.545222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.545340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 470/934] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:21.546756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.551574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.559086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 465/935] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:21.559938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.570396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b26af-111a-4b73-8676-b1d36d0a3763 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.572356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eecb3-6eb9-4d81-9afb-ce61ed47f5bf admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.576630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.577295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.577577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.577856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.578581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.578900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.579441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.581219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.581422 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.581573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.581573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.581573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.582148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.584049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.586024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 466/936] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:21.592776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.603193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7837fa-74d0-4f23-adea-887060f250c7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.609770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.610463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.610750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.611027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.611801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 471/937] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:21.611971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.614463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.618640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.628283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656323-8c1e-4ce6-8748-01bd5834a244 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.632919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.637530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.637530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.637530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.642326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.644123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.653605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 472/938] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/auth/tokens => generated 2977 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:45:21.660068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.669623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b53353-725d-4e07-bda6-33e4e396d73d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.681196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.681196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.681196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.681196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.686435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.688283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.714625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 467/939] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:45:21 2021] POST /identity/v3/endpoints => generated 327 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:45:21.714860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:21.714860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 473/940] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:21.715048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.738916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f94fa-3371-4e6b-80de-b05c43efc968 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.744958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.745564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.745847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.746125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.746904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.747213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.748858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.762392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 468/941] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:21.769457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.781276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8473d-516c-42a6-a6d6-7e58c9e16550 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.786701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.788406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.788525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.788875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.799378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.801746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.817028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:21.818468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 474/942] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:21.826256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.837489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325cb8-fc1e-4511-bc9a-4daabffa18f4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.842616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.843306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.843594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.843917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.844717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.845082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.847044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0baab-d348-4370-97b3-1410ace0e1b7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.863314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 469/943] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:21.871406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:21.884273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fddb9c-c1bc-42dc-b6b1-ef10faf0418b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:21.889930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:21.890634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:21.890983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:21.891262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:21.892103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] RBAC: Adding query filter params (role.id=78ee25a54d164663a763cefedde9e9fe, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=bb32cee436d24774b51fa67a73ef342d) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:21.892411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:21.894361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c7ed-8a2a-4d7b-9477-4a7c848d9314 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:21.901910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 475/944] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:21 2021] GET /identity/v3/role_assignments?user.id=bb32cee436d24774b51fa67a73ef342d&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=78ee25a54d164663a763cefedde9e9fe => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:23.591688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d06fe-7458-4ab0-a13b-2976987c4975 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:23.592231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d06fe-7458-4ab0-a13b-2976987c4975 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:23.592603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d06fe-7458-4ab0-a13b-2976987c4975 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:23.594405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 470/945] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:23.601071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:23.601568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:23.601648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:23.619621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:23.620813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:23.628815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 476/946] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:23.655387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d06fe-7458-4ab0-a13b-2976987c4975 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:23.668504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d06fe-7458-4ab0-a13b-2976987c4975 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:23.673337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cb58f-d6c0-4736-8850-aedab9013f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:23.674174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cb58f-d6c0-4736-8850-aedab9013f92 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:23.674384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cb58f-d6c0-4736-8850-aedab9013f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:23.674699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cb58f-d6c0-4736-8850-aedab9013f92 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:23.675868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cb58f-d6c0-4736-8850-aedab9013f92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:23.677559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cb58f-d6c0-4736-8850-aedab9013f92 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:23.679625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 471/947] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:23.685766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:23.695093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9807d-b74e-462e-9580-4e85488ee778 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:23.699620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443112d8-3eb9-4d00-a432-a9d2d62f8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:23.700289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443112d8-3eb9-4d00-a432-a9d2d62f8cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:23.700572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443112d8-3eb9-4d00-a432-a9d2d62f8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:23.700849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443112d8-3eb9-4d00-a432-a9d2d62f8cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:23.701559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443112d8-3eb9-4d00-a432-a9d2d62f8cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:23.704529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443112d8-3eb9-4d00-a432-a9d2d62f8cc4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:23.774609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 477/948] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:45:23 2021] POST /identity/v3/users => generated 285 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:23.962488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281928b-30ef-4240-a785-ebac316e7cbc None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:23.962844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281928b-30ef-4240-a785-ebac316e7cbc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:23.963124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281928b-30ef-4240-a785-ebac316e7cbc None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:23.964917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 472/949] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:23.971383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:23.971831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:23.972220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:23.995720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:23.997138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:24.004911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 478/950] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:24.028280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281928b-30ef-4240-a785-ebac316e7cbc None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.044406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281928b-30ef-4240-a785-ebac316e7cbc None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.049204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab377-3d8c-4514-927b-2b50d3d52f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.049888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab377-3d8c-4514-927b-2b50d3d52f25 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.050171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab377-3d8c-4514-927b-2b50d3d52f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.050450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab377-3d8c-4514-927b-2b50d3d52f25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.061073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab377-3d8c-4514-927b-2b50d3d52f25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.062890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab377-3d8c-4514-927b-2b50d3d52f25 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.078634 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 473/951] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:24.086241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.095617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0c84f-6cc3-4995-9ed6-d7899d3af80f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.100211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92052b-175d-4f01-be50-9a4f2e0c5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.102257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92052b-175d-4f01-be50-9a4f2e0c5d29 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.102542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92052b-175d-4f01-be50-9a4f2e0c5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.102849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92052b-175d-4f01-be50-9a4f2e0c5d29 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.104084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92052b-175d-4f01-be50-9a4f2e0c5d29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.105804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92052b-175d-4f01-be50-9a4f2e0c5d29 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.107675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 479/952] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:24.129334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80a8d-364a-4402-aca2-8f853e2c26b8 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.129639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80a8d-364a-4402-aca2-8f853e2c26b8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.129907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80a8d-364a-4402-aca2-8f853e2c26b8 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.132740 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 474/953] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:24.139567 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.139996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.140373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.160091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:24.161515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:24.170148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 480/954] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:24.194579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf80a8d-364a-4402-aca2-8f853e2c26b8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.208202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf80a8d-364a-4402-aca2-8f853e2c26b8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.213897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.214796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.215153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.215504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.227943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:24.235537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:45:24.237021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 475/955] 10.222.0.73 () {56 vars in 1142 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:24.244515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.254130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c5f7-01aa-43b9-995b-61786e9d39c8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.259122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.259820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.260092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.260373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.261148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:24.261458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.263125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.273767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 481/956] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:24.280683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.293085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4130c-f2bd-4992-a808-84e7cefdd447 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.297921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.298939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.299287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.299635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.312636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.314733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.334937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:24.336818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 476/957] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:24.342943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.353408 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274a92-ba43-457b-85df-e0aab63c912e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.358338 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.359066 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.359356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.359636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.360383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:24.360695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.362301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.377351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 482/958] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:24.384555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.396615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7504a-365a-4f3e-bf18-01082dc215fd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.403654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.404563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.404940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.405300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.415725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.418198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.433900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:45:24.435507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 477/959] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:24.441943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.454986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d45aad-adb1-4488-9e9f-59e2da9505b9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.461818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.462534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.462887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.463165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.464085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:24.464326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.466196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.484610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 483/960] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:24.491658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.501335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc9094-ed53-42e2-8caf-02d99df09c31 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.505834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.507206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.507478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.507901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.518179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.520042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.538425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:24.539679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 478/961] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:24.546390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.556412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573316e-ed4e-485e-b26e-e5cf07207f79 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.561173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.561896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.562251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.562630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.563434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:24.563809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.565542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.582552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 484/962] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:24.583836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.595184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3adb8-7d9c-414b-881d-d0d31a44d768 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.600108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.601578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.601882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.602119 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.609433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.611421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.624543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:24.625748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 479/963] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:24.634231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.644000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574d7b8-81ea-45e4-b482-74c45c8bda19 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.649856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.650605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.650966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.651311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.652170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:24.652550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.654463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929351b-57a2-4828-8025-c19c64ea7e5a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.667367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 485/964] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:24.674000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:24.684844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112d073-554f-409e-85ea-1e201cb98cc3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:24.689372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c6e03-7dd6-4d2b-b8d5-8fb7a2f00880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:24.690239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6e03-7dd6-4d2b-b8d5-8fb7a2f00880 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:24.690524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6e03-7dd6-4d2b-b8d5-8fb7a2f00880 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:24.690997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6e03-7dd6-4d2b-b8d5-8fb7a2f00880 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/bb32cee436d24774b51fa67a73ef342d/roles/78ee25a54d164663a763cefedde9e9fe` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:24.693171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6e03-7dd6-4d2b-b8d5-8fb7a2f00880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=bb32cee436d24774b51fa67a73ef342d, role_id=78ee25a54d164663a763cefedde9e9fe)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:24.696900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6e03-7dd6-4d2b-b8d5-8fb7a2f00880 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:24.800928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 480/965] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:45:24 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/bb32cee436d24774b51fa67a73ef342d/roles/78ee25a54d164663a763cefedde9e9fe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:45:26.039767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d807-2f45-4ebb-adcb-db653015f019 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.040277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d807-2f45-4ebb-adcb-db653015f019 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.040387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02d807-2f45-4ebb-adcb-db653015f019 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.042502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 486/966] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:26.048231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.048620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.048786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.066474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:26.067702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:26.123619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 481/967] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:26.148313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02d807-2f45-4ebb-adcb-db653015f019 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:26.160200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02d807-2f45-4ebb-adcb-db653015f019 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:26.165248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:26.166272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.166550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.166845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.176561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:26.183843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:26.185324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 487/968] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:26.191702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:26.200603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761e31-cf62-47a9-9075-2a39ae9d84b7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:26.205083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:26.205735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.206015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.206287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.207051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:26.207353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:26.208943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:26.217045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 482/969] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:26.223367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:26.234111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bbe44-05dc-47c8-9165-432477876882 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:26.238479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:26.239354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.239633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.239904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] PATH_INFO: `/v3/users/62f9c05257a64b5ca259c9df6faa65d8` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.253483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] RBAC: Authorizing `identity:get_user(user_id=62f9c05257a64b5ca259c9df6faa65d8)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:26.255646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:26.257381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 488/970] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:26 2021] GET /identity/v3/users/62f9c05257a64b5ca259c9df6faa65d8 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:26.264114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:26.273776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c21da-922c-4c90-9e1d-ff315d629708 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:26.278363 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:26.279038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.279324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.279631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.287232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:26.289497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:26.298402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 483/971] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:26.305383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:26.314785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9764-1375-4efa-a559-a4b29a212385 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:26.319201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2c27-7167-47f7-9c4d-d3196960cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:26.320038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2c27-7167-47f7-9c4d-d3196960cfff admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.320320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2c27-7167-47f7-9c4d-d3196960cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.320593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2c27-7167-47f7-9c4d-d3196960cfff admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.321735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2c27-7167-47f7-9c4d-d3196960cfff admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:26.323774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2c27-7167-47f7-9c4d-d3196960cfff admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:26.330578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 489/972] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:26 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:26.331739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:26.341519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05261dbd-49c7-4c25-a753-857f0d90905d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:26.346022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:26.346693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.346977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.347254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.348073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=a3fb454a96cf4135a4a2d39185c4902e, user.id=62f9c05257a64b5ca259c9df6faa65d8) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:26.348383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:26.350790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a29fd-92d3-4cf9-a1ce-d70bb37dc901 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:26.360818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 484/973] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:26 2021] GET /identity/v3/role_assignments?user.id=62f9c05257a64b5ca259c9df6faa65d8&scope.project.id=a3fb454a96cf4135a4a2d39185c4902e&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:26.967858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7202-ee1f-4cc2-8e6d-21df8d97f1f9 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.968140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7202-ee1f-4cc2-8e6d-21df8d97f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.968418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7202-ee1f-4cc2-8e6d-21df8d97f1f9 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.970254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 490/974] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:26.976784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:26.977076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:26.977358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:26.998899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:27.000407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:27.012157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 485/975] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:27.037169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7202-ee1f-4cc2-8e6d-21df8d97f1f9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.049956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7202-ee1f-4cc2-8e6d-21df8d97f1f9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.054535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.055391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.055671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.055944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.066468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:27.074430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:45:27.076959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 491/976] 10.222.0.73 () {56 vars in 1142 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:27.082370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.092009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf124a-4cf6-4df1-a255-5a9f5ecb4ed3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.096523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.097185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.097463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.097733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.098470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:27.098799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.100548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.109210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 486/977] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:27.115890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.126711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d53af-0283-4a4a-b0de-84972e32d2f5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.131233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.132565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.132843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.133114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.143704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.145544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.164045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:27.165289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 492/978] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:27.172335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.182587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9fb8d-b304-4939-a529-efe1aebaab6d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.187095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.187822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.188102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.188376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.189085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:27.189386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.191009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.203469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 487/979] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:27.209792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.219980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81601-275d-4e05-994b-3cb272ac1225 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.224485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.225896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.226322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.226690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.234196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.236371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.251218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:45:27.252621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 493/980] 10.222.0.73 () {56 vars in 1115 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:45:27.258896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.268774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422a53a-7831-4afb-8c01-6a729d166a3c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.275458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.276205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.276487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.276758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.277592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:27.277895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.279809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.298250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 488/981] 10.222.0.73 () {56 vars in 1155 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:27.305092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.314846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3393-9def-4cff-9a37-149122dd7d8e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.319887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.320685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.320964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.321232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.329513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.331349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.340587 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 494/982] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:27.348420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.358123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9ec43-ad1a-4d3d-97fe-ef3f7c6082ac admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.362659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.363443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.363721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.363992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.374770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.376626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.396653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:45:27.398451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 489/983] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:27.404670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.414217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5ff1a-6e36-41f5-aacc-480ccd71aed3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.419116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.419792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.420058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.420332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.421055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:27.421358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.423012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.435185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 495/984] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:27.441376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.451940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d083-8f07-436e-872b-d103966bfd7c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.456556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.457358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.457644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.457921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.466669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.468655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.483472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:45:27.484620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 490/985] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:27.491847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.501756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39499b-1903-45eb-86b6-cc98ca83a2d1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.506375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.507707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.508091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.508275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.509078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:27.509391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.511289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbccdc7-f299-48cb-a1e0-d67f43cb6adf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.526364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 496/986] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:27.533005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:27.544896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad190da-360d-4a51-b855-a51dc0db2c30 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:27.549313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:27.549961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:27.550240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:27.550589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:27.551377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] RBAC: Adding query filter params (role.id=78ee25a54d164663a763cefedde9e9fe, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=bb32cee436d24774b51fa67a73ef342d) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:27.551684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:27.553762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0f891-5d05-4726-8e6f-2fd0cd065fe2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:27.560224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 491/987] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:27 2021] GET /identity/v3/role_assignments?user.id=bb32cee436d24774b51fa67a73ef342d&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=78ee25a54d164663a763cefedde9e9fe => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:28.583329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9757-696a-4652-8a11-dd589853ada8 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.583858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9757-696a-4652-8a11-dd589853ada8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.583858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9757-696a-4652-8a11-dd589853ada8 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.586451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 497/988] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:28.592557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.593006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.593120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.610616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:28.611816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:28.620462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 492/989] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:28.644820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9757-696a-4652-8a11-dd589853ada8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:28.657595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9757-696a-4652-8a11-dd589853ada8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:28.661996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:28.662940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.663223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.663497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.673952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:28.681116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:28.682307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 498/990] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:28.689105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:28.699196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488127d0-b7b9-4bcd-a281-0da4db3ac812 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:28.703756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:28.704413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.704720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.704999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.705742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:28.706046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:28.707787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:28.718278 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 493/991] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:28.724815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:28.734626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7674f-b3a7-49f8-b6b1-fca8a23fedc7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:28.739211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:28.740078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.740359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.741132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] PATH_INFO: `/v3/users/62f9c05257a64b5ca259c9df6faa65d8` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.742478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] RBAC: Authorizing `identity:get_user(user_id=62f9c05257a64b5ca259c9df6faa65d8)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:28.744634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:28.746239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 499/992] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:28 2021] GET /identity/v3/users/62f9c05257a64b5ca259c9df6faa65d8 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:28.752671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:28.763648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f83447-197c-4beb-8aea-429d0f64c4c0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:28.768305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac271-55d1-4fb0-b9f0-1c72b0964328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:28.769160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac271-55d1-4fb0-b9f0-1c72b0964328 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.769444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac271-55d1-4fb0-b9f0-1c72b0964328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.769721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac271-55d1-4fb0-b9f0-1c72b0964328 admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.770933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ac271-55d1-4fb0-b9f0-1c72b0964328 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:28.773584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ac271-55d1-4fb0-b9f0-1c72b0964328 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:28.775284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 494/993] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:28 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:28.781912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:28.792448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f489bf-a07c-459f-941d-43d9d41616bc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:28.796915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084ec-065b-42b5-8b6e-190881c77bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:28.797779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084ec-065b-42b5-8b6e-190881c77bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:28.798055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084ec-065b-42b5-8b6e-190881c77bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:28.798322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084ec-065b-42b5-8b6e-190881c77bb4 admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e/users/62f9c05257a64b5ca259c9df6faa65d8/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:28.800250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084ec-065b-42b5-8b6e-190881c77bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fb454a96cf4135a4a2d39185c4902e, user_id=62f9c05257a64b5ca259c9df6faa65d8, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:28.802900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084ec-065b-42b5-8b6e-190881c77bb4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:28.926484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 500/994] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:45:28 2021] PUT /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e/users/62f9c05257a64b5ca259c9df6faa65d8/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:45:31.105229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754a41d-9fe2-4659-a53a-bb1b1b45fc41 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.105756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754a41d-9fe2-4659-a53a-bb1b1b45fc41 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.105756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754a41d-9fe2-4659-a53a-bb1b1b45fc41 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.107724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 495/995] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:31.113968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.114416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.114521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.132404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:31.133612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:31.191879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 501/996] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:31.217365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754a41d-9fe2-4659-a53a-bb1b1b45fc41 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:31.234839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754a41d-9fe2-4659-a53a-bb1b1b45fc41 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:31.236331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:31.237127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.237409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.237682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.249389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:31.256439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:31.257970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 496/997] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:31.264615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:31.274197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772bc8d-ac8c-4410-8c26-846bbbedfd4e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:31.278845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:31.279506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.279791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.280062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.280812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:31.281120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:31.282747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:31.292347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 502/998] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:31.299038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:31.311347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad83a1-57ea-4838-b76f-c3b0f68e0f3d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:31.315927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:31.316783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.317066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.317339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] PATH_INFO: `/v3/users/62f9c05257a64b5ca259c9df6faa65d8` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.318533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] RBAC: Authorizing `identity:get_user(user_id=62f9c05257a64b5ca259c9df6faa65d8)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:31.321985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:31.323659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 497/999] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:31 2021] GET /identity/v3/users/62f9c05257a64b5ca259c9df6faa65d8 => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:31.330221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:31.340854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74251ba0-6c53-469b-926a-fa0fd638af90 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:31.345928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:31.346601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.346891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.347167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.357051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:31.358855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:31.368961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 503/1000] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:31 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:31.375545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:31.386392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc95c-ae2c-48a8-a856-dbffea402347 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:31.391438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b642592-40f9-449b-ba6f-eb9afa4ece9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:31.392287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b642592-40f9-449b-ba6f-eb9afa4ece9f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.392562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b642592-40f9-449b-ba6f-eb9afa4ece9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.392833 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b642592-40f9-449b-ba6f-eb9afa4ece9f admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.394298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b642592-40f9-449b-ba6f-eb9afa4ece9f admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:31.396398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b642592-40f9-449b-ba6f-eb9afa4ece9f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:31.398863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 498/1001] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:31 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:31.406787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:31.416765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccf587-2082-43f8-b7b3-2723e49c5e9a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:31.422180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86954700-de96-4206-9648-93cd9240500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:31.422863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86954700-de96-4206-9648-93cd9240500a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:31.423146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86954700-de96-4206-9648-93cd9240500a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:31.423420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86954700-de96-4206-9648-93cd9240500a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:31.424243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86954700-de96-4206-9648-93cd9240500a admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=a3fb454a96cf4135a4a2d39185c4902e, user.id=62f9c05257a64b5ca259c9df6faa65d8) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:31.424555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86954700-de96-4206-9648-93cd9240500a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:31.426443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86954700-de96-4206-9648-93cd9240500a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:31.433811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 504/1002] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:31 2021] GET /identity/v3/role_assignments?user.id=62f9c05257a64b5ca259c9df6faa65d8&scope.project.id=a3fb454a96cf4135a4a2d39185c4902e&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:33.634630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a162f8-6336-4f16-a9c3-1bce59866f71 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:33.635185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a162f8-6336-4f16-a9c3-1bce59866f71 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:33.635185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a162f8-6336-4f16-a9c3-1bce59866f71 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:33.636959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 499/1003] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:33.643595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:33.644271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:33.644271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:33.661485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:33.663488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:33.671582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 505/1004] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:33.699213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a162f8-6336-4f16-a9c3-1bce59866f71 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:33.711933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a162f8-6336-4f16-a9c3-1bce59866f71 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:33.716283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f706bf-90eb-4f15-bc51-4a63ac5bdaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:33.717064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f706bf-90eb-4f15-bc51-4a63ac5bdaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:33.717341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f706bf-90eb-4f15-bc51-4a63ac5bdaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:33.717616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f706bf-90eb-4f15-bc51-4a63ac5bdaa1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:33.718785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f706bf-90eb-4f15-bc51-4a63ac5bdaa1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:33.720446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f706bf-90eb-4f15-bc51-4a63ac5bdaa1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:33.722021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 500/1005] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:33.729058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:33.738172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93872352-705f-477b-ae0e-e2202e4a02d0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:33.743426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b9020-bff7-487f-b760-1167fdb13ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:33.744093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b9020-bff7-487f-b760-1167fdb13ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:33.744371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b9020-bff7-487f-b760-1167fdb13ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:33.744641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b9020-bff7-487f-b760-1167fdb13ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:33.745352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b9020-bff7-487f-b760-1167fdb13ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:33.747487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b9020-bff7-487f-b760-1167fdb13ce7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:33.823237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 506/1006] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:45:33 2021] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:36.063772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f973-ec0c-44df-846f-61c17320e69b None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.064293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f973-ec0c-44df-846f-61c17320e69b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.064411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f973-ec0c-44df-846f-61c17320e69b None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.066088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 501/1007] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:36.072971 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.073419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.073536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.091932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:36.093119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:36.100825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 507/1008] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:36.124692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f973-ec0c-44df-846f-61c17320e69b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:36.137562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f973-ec0c-44df-846f-61c17320e69b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:36.141893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:36.142764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.143046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.143327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] PATH_INFO: `/v3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.144775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] RBAC: Authorizing `identity:get_role(role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:36.145773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:45:36.145773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:45:36.145773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:45:36.147399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:36.148722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 502/1009] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:36 2021] GET /identity/v3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:36.154934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:36.163830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534abe1f-c29e-46c4-8393-50ecfdbffbe7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:36.168499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:36.169344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.169623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.169892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] PATH_INFO: `/v3/users/b29823f852e6418da3c59aa61fd53516` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.182755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29823f852e6418da3c59aa61fd53516)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:36.184884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:36.186498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 508/1010] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:36 2021] GET /identity/v3/users/b29823f852e6418da3c59aa61fd53516 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:36.192820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:36.203073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f91072-f806-49b1-bb5f-447a2e6eef1f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:36.207590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:36.208224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.208510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.208784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.217432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:36.219201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:36.228191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 503/1011] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:36.234979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:36.245786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31185d4-9fbf-41d4-8f6d-181f40aedca8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:36.258964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52e665-c54a-4152-844d-35138e011fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:36.259837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e665-c54a-4152-844d-35138e011fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.260123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e665-c54a-4152-844d-35138e011fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.260402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e665-c54a-4152-844d-35138e011fd0 admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.261597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52e665-c54a-4152-844d-35138e011fd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:36.263711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52e665-c54a-4152-844d-35138e011fd0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:36.265404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 509/1012] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:36 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:36.272757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:36.281891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a6cc2-dd61-410b-9b1c-255b0d09f132 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:36.286495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:36.287223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:36.287509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:36.287824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:36.288711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] RBAC: Adding query filter params (role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=a3fb454a96cf4135a4a2d39185c4902e, user.id=b29823f852e6418da3c59aa61fd53516) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:36.289027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:36.291143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e749f-fddb-4596-a54d-6628c363ba2f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:36.296656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 504/1013] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:36 2021] GET /identity/v3/role_assignments?user.id=b29823f852e6418da3c59aa61fd53516&scope.project.id=a3fb454a96cf4135a4a2d39185c4902e&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:38.434503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267c97c-4974-4fb6-8740-2dbd5a0c2e36 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:38.435080 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267c97c-4974-4fb6-8740-2dbd5a0c2e36 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:38.435080 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267c97c-4974-4fb6-8740-2dbd5a0c2e36 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:38.436871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 510/1014] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:38.442716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:38.443130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:38.443347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:38.460624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:38.461811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:38.469335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 505/1015] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:38.494209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267c97c-4974-4fb6-8740-2dbd5a0c2e36 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:38.506352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267c97c-4974-4fb6-8740-2dbd5a0c2e36 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:38.510698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:38.511539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:38.511822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:38.512095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] PATH_INFO: `/v3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:38.513539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] RBAC: Authorizing `identity:get_role(role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:38.514548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:45:38.514548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:45:38.514548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:45:38.515453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:38.516759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 511/1016] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:38 2021] GET /identity/v3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:38.523711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:38.532517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6bca-1f8d-4d25-ad22-051a1c84c2a7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:38.537702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:38.538595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:38.538882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:38.539164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] PATH_INFO: `/v3/users/b29823f852e6418da3c59aa61fd53516` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:38.540351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29823f852e6418da3c59aa61fd53516)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:38.542742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:38.544309 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 506/1017] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:38 2021] GET /identity/v3/users/b29823f852e6418da3c59aa61fd53516 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:38.550540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:38.560594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061734-e61e-433f-8c74-0df3db23e259 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:38.565119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab523f-c7f3-49aa-8f39-9ddaa245d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:38.565955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab523f-c7f3-49aa-8f39-9ddaa245d54b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:38.566240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab523f-c7f3-49aa-8f39-9ddaa245d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:38.566520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab523f-c7f3-49aa-8f39-9ddaa245d54b admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:38.567733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab523f-c7f3-49aa-8f39-9ddaa245d54b admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:38.570185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab523f-c7f3-49aa-8f39-9ddaa245d54b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:38.571859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 512/1018] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:38 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:38.580128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:38.592047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8730bb-d04d-4dc6-8cc6-31a19e014725 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:38.600162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361366-d678-4698-b7ef-32931d5f8e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:38.601685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361366-d678-4698-b7ef-32931d5f8e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:38.601965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361366-d678-4698-b7ef-32931d5f8e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:38.602235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361366-d678-4698-b7ef-32931d5f8e53 admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e/users/b29823f852e6418da3c59aa61fd53516/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:38.604438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e361366-d678-4698-b7ef-32931d5f8e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fb454a96cf4135a4a2d39185c4902e, user_id=b29823f852e6418da3c59aa61fd53516, role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:38.607193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e361366-d678-4698-b7ef-32931d5f8e53 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:38.761264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 507/1019] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:45:38 2021] PUT /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e/users/b29823f852e6418da3c59aa61fd53516/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:45:40.888200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cc9da-cd30-4d8c-a687-ed4bfe639074 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:40.888738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cc9da-cd30-4d8c-a687-ed4bfe639074 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:40.888738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cc9da-cd30-4d8c-a687-ed4bfe639074 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:40.890528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 513/1020] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:40.896919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:40.897297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:40.897472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:40.915244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:40.916663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:40.970752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 508/1021] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:40.995861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cc9da-cd30-4d8c-a687-ed4bfe639074 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:41.008426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cc9da-cd30-4d8c-a687-ed4bfe639074 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:41.012851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:41.013694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:41.013980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:41.014258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] PATH_INFO: `/v3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:41.015752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] RBAC: Authorizing `identity:get_role(role_id=bdb68d33bb5d42c68fcc0b58abdc27b0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:41.017353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:41.018701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 514/1022] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:40 2021] GET /identity/v3/roles/bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:41.025527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:41.034450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c0ce0-f29e-48d7-b885-17ffff302c44 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:41.039834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:41.040683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:41.041213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:41.041481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] PATH_INFO: `/v3/users/b29823f852e6418da3c59aa61fd53516` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:41.042693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29823f852e6418da3c59aa61fd53516)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:41.044920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:41.046489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 509/1023] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:41 2021] GET /identity/v3/users/b29823f852e6418da3c59aa61fd53516 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:41.053011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:41.062517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e855e-7832-46b7-a763-6e287c4a9d12 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:41.067082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:41.067716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:41.067999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:41.068810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:41.076424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:41.078161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:41.087921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 515/1024] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:41.094292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:41.103865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041faf-595c-42ff-87ff-622012455359 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:41.108307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8bf9-1e33-4276-a61e-3bfe4a47c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:41.109133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8bf9-1e33-4276-a61e-3bfe4a47c604 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:41.109410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8bf9-1e33-4276-a61e-3bfe4a47c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:41.109679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8bf9-1e33-4276-a61e-3bfe4a47c604 admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:41.110845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d8bf9-1e33-4276-a61e-3bfe4a47c604 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:41.112847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d8bf9-1e33-4276-a61e-3bfe4a47c604 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:41.114451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 510/1025] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:41 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:41.121463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:41.130176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15feb-ba32-4d6c-84d8-18ab4208dc36 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:41.135311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:41.135956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:41.136239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:41.136514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:41.137493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] RBAC: Adding query filter params (role.id=bdb68d33bb5d42c68fcc0b58abdc27b0, scope.project.id=a3fb454a96cf4135a4a2d39185c4902e, user.id=b29823f852e6418da3c59aa61fd53516) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:41.137805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:41.139732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e81d99-3bb1-4a03-915e-79a6986db59c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:41.145383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 516/1026] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:41 2021] GET /identity/v3/role_assignments?user.id=b29823f852e6418da3c59aa61fd53516&scope.project.id=a3fb454a96cf4135a4a2d39185c4902e&role.id=bdb68d33bb5d42c68fcc0b58abdc27b0 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:43.481342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df58b3-6b23-47a7-a3f5-a64b61849827 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:43.481912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df58b3-6b23-47a7-a3f5-a64b61849827 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:43.481912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df58b3-6b23-47a7-a3f5-a64b61849827 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:43.483761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 511/1027] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:43.490028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:43.490485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:43.490680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:43.508968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:43.510164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:43.518252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 517/1028] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:43.544566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df58b3-6b23-47a7-a3f5-a64b61849827 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:43.556726 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df58b3-6b23-47a7-a3f5-a64b61849827 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:43.561100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ec9c-bed6-472e-aedc-9183bfe3a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:43.561882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ec9c-bed6-472e-aedc-9183bfe3a979 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:43.562161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ec9c-bed6-472e-aedc-9183bfe3a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:43.562434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ec9c-bed6-472e-aedc-9183bfe3a979 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:43.563603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ec9c-bed6-472e-aedc-9183bfe3a979 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:43.565365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ec9c-bed6-472e-aedc-9183bfe3a979 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:43.566976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 512/1029] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:43.574769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:43.584983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121821d-5c9e-4a7e-8a1a-1c7973b4c4a0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:43.590254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c981-05a1-43bc-8f8e-8e8535f0c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:43.590944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c981-05a1-43bc-8f8e-8e8535f0c1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:43.591230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c981-05a1-43bc-8f8e-8e8535f0c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:43.591505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c981-05a1-43bc-8f8e-8e8535f0c1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:43.592209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c981-05a1-43bc-8f8e-8e8535f0c1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:43.594108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c981-05a1-43bc-8f8e-8e8535f0c1b7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:43.675679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 518/1030] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:45:43 2021] POST /identity/v3/projects => generated 311 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:45:45.827264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53456b3-b21f-4f46-8ec8-35854540cda6 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:45.827790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53456b3-b21f-4f46-8ec8-35854540cda6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:45.827790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53456b3-b21f-4f46-8ec8-35854540cda6 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:45.829599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 513/1031] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:45.836341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:45.836714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:45.836893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:45.854578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:45.855761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:45.911150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 519/1032] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:45.937821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53456b3-b21f-4f46-8ec8-35854540cda6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:45.949876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53456b3-b21f-4f46-8ec8-35854540cda6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:45.954210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa14b31-ed7e-4bb5-a2f5-edd7d29ec4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:45.955025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa14b31-ed7e-4bb5-a2f5-edd7d29ec4df admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:45.955307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa14b31-ed7e-4bb5-a2f5-edd7d29ec4df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:45.955579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa14b31-ed7e-4bb5-a2f5-edd7d29ec4df admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:45.956736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa14b31-ed7e-4bb5-a2f5-edd7d29ec4df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:45.958410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa14b31-ed7e-4bb5-a2f5-edd7d29ec4df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:45.960183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 514/1033] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:45:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:45.966647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:45.976165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cc496-335a-4eea-9b02-b12a9f2f9ea6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:45.980702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a22384-f52f-4d17-9f21-dd0ab5782abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:45.981360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a22384-f52f-4d17-9f21-dd0ab5782abe admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:45.981639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a22384-f52f-4d17-9f21-dd0ab5782abe admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:45.981914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a22384-f52f-4d17-9f21-dd0ab5782abe admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:45.982651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a22384-f52f-4d17-9f21-dd0ab5782abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:45.984566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a22384-f52f-4d17-9f21-dd0ab5782abe admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:46.097565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 520/1034] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:45:45 2021] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:45:48.310158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff309f-7c99-4477-bca4-bb78e8bb88e7 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.310717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff309f-7c99-4477-bca4-bb78e8bb88e7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.310717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff309f-7c99-4477-bca4-bb78e8bb88e7 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.312425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 515/1035] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:48.318736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.319186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.319299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.337476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:48.338748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:48.346382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 521/1036] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:48.371714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff309f-7c99-4477-bca4-bb78e8bb88e7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:48.384162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff309f-7c99-4477-bca4-bb78e8bb88e7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:48.388603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:48.389386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.389669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.389943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.401164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:48.407943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:48.409132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 516/1037] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:48.416893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:48.425827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f37ff-4aee-4113-aaf4-4c6e18d028d9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:48.430895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:48.431565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.431847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.432120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.432876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:48.433177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:48.434805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:48.443612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 522/1038] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:48.450260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:48.461089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0195b-c9ce-4793-8199-3bd9d9b0aa3a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:48.465694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:48.466542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.466850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.467121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] PATH_INFO: `/v3/users/b1a14a2e443249af8b59bd4f0526a89f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.481249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b1a14a2e443249af8b59bd4f0526a89f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:48.483413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:48.485137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 517/1039] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:48 2021] GET /identity/v3/users/b1a14a2e443249af8b59bd4f0526a89f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:48.491795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:48.501480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef0bc3-772d-4cd0-b567-8efd50be07ee admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:48.506180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:48.506886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.507256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.507444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.515390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:48.517142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:48.526600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 523/1040] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:48 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:48.533290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:48.543851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ca49-d785-43e9-8613-a4c958b445d9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:48.548437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770d96-cd99-463c-bd30-3b6a2dc07651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:48.549294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770d96-cd99-463c-bd30-3b6a2dc07651 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.549575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770d96-cd99-463c-bd30-3b6a2dc07651 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.549846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770d96-cd99-463c-bd30-3b6a2dc07651 admin admin] PATH_INFO: `/v3/projects/b347274669c442b193f5be927dc3bffd` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.551033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770d96-cd99-463c-bd30-3b6a2dc07651 admin admin] RBAC: Authorizing `identity:get_project(project_id=b347274669c442b193f5be927dc3bffd)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:48.553240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770d96-cd99-463c-bd30-3b6a2dc07651 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:48.554931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 518/1041] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:48 2021] GET /identity/v3/projects/b347274669c442b193f5be927dc3bffd => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:48.561785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:48.570902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2a86f-e82e-49ba-b9d6-67f568e9a6fb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:48.575531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:48.576180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:48.576464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:48.576739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:48.577569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=b347274669c442b193f5be927dc3bffd, user.id=b1a14a2e443249af8b59bd4f0526a89f) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:48.577878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:48.579773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7fc47-4b07-4912-93e2-96ba1b83d886 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:48.586213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 524/1042] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:48 2021] GET /identity/v3/role_assignments?user.id=b1a14a2e443249af8b59bd4f0526a89f&scope.project.id=b347274669c442b193f5be927dc3bffd&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:50.756643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46209-07fc-47df-a181-ed5fa6b86593 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.757206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46209-07fc-47df-a181-ed5fa6b86593 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.757206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46209-07fc-47df-a181-ed5fa6b86593 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.758995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 519/1043] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:50.764915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.765330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.765484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.783499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:50.784707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:50.793495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 525/1044] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:50.819024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a46209-07fc-47df-a181-ed5fa6b86593 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:50.831042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a46209-07fc-47df-a181-ed5fa6b86593 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:50.836498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:50.837281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.837565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.837841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.847812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:50.855703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:50.856874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 520/1045] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:50.863564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:50.872468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a866e62-b49f-4641-9acd-b283a4fc8627 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:50.876984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:50.877699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.877987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.878260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.879044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:50.879431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:50.881644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:50.889892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 526/1046] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:50.896948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:50.907197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6fb0-8a02-41a9-ad33-b252fc1c99b5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:50.911857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:50.912705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.917604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.917604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] PATH_INFO: `/v3/users/b1a14a2e443249af8b59bd4f0526a89f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.917604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] RBAC: Authorizing `identity:get_user(user_id=b1a14a2e443249af8b59bd4f0526a89f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:50.917604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:50.918454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 521/1047] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:50 2021] GET /identity/v3/users/b1a14a2e443249af8b59bd4f0526a89f => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:45:50.924663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:50.934437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53199-d837-4191-88fb-18ce04899e5f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:50.938921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c4672-28e8-4582-a792-1c092af203cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:50.939757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4672-28e8-4582-a792-1c092af203cb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.940037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4672-28e8-4582-a792-1c092af203cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.940309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4672-28e8-4582-a792-1c092af203cb admin admin] PATH_INFO: `/v3/projects/b347274669c442b193f5be927dc3bffd` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.941451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4672-28e8-4582-a792-1c092af203cb admin admin] RBAC: Authorizing `identity:get_project(project_id=b347274669c442b193f5be927dc3bffd)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:50.944050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4672-28e8-4582-a792-1c092af203cb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:50.945673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 527/1048] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:50 2021] GET /identity/v3/projects/b347274669c442b193f5be927dc3bffd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:50.952127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:50.962239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153593b-ea16-4c13-9284-c69557a46ab3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:50.966772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c25c3e-b69f-471a-a2d6-f84fc8486a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:50.967638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25c3e-b69f-471a-a2d6-f84fc8486a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:50.967920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25c3e-b69f-471a-a2d6-f84fc8486a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:50.968333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25c3e-b69f-471a-a2d6-f84fc8486a29 admin admin] PATH_INFO: `/v3/projects/b347274669c442b193f5be927dc3bffd/users/b1a14a2e443249af8b59bd4f0526a89f/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:50.970110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c25c3e-b69f-471a-a2d6-f84fc8486a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b347274669c442b193f5be927dc3bffd, user_id=b1a14a2e443249af8b59bd4f0526a89f, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:50.972772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c25c3e-b69f-471a-a2d6-f84fc8486a29 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:51.104301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 522/1049] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:45:50 2021] PUT /identity/v3/projects/b347274669c442b193f5be927dc3bffd/users/b1a14a2e443249af8b59bd4f0526a89f/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:45:53.295423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676f43-0542-4f26-ad47-19637b0b9121 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.295970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676f43-0542-4f26-ad47-19637b0b9121 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.295970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676f43-0542-4f26-ad47-19637b0b9121 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.297641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 528/1050] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:53.304287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.304761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.304859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.322304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:53.323545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:53.380368 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 523/1051] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:45:53.405146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676f43-0542-4f26-ad47-19637b0b9121 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:53.417881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676f43-0542-4f26-ad47-19637b0b9121 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:53.422161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:53.422980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.423260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.423531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.434117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:45:53.440799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:45:53.441983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 529/1052] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:45:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:53.448810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:53.457766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3e9c-7dd2-4357-a890-4ab1ac632b84 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:53.462739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:53.463400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.463683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.463960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.464703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:53.465009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:53.466622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:53.475497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 524/1053] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:45:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:53.481851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:53.495356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6f0b-d886-4407-885d-447e0b16770c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:53.501013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:53.501882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.502166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.502448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] PATH_INFO: `/v3/users/b1a14a2e443249af8b59bd4f0526a89f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.503681 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] RBAC: Authorizing `identity:get_user(user_id=b1a14a2e443249af8b59bd4f0526a89f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:53.506246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:53.508345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 530/1054] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:45:53 2021] GET /identity/v3/users/b1a14a2e443249af8b59bd4f0526a89f => generated 286 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:53.514916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:53.525833 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df0dd-31ab-4203-a1be-f97e769d4dfa admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:53.530349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:53.531015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.531295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.531569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.539987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:53.541961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:53.550585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 525/1055] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:45:53.556992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:53.566537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e41051-d51d-4656-90f3-8b9e84a98202 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:53.571641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2610f-f632-4be9-9e45-91922e9a557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:53.572484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2610f-f632-4be9-9e45-91922e9a557f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.572766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2610f-f632-4be9-9e45-91922e9a557f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.573041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2610f-f632-4be9-9e45-91922e9a557f admin admin] PATH_INFO: `/v3/projects/b347274669c442b193f5be927dc3bffd` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.574193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2610f-f632-4be9-9e45-91922e9a557f admin admin] RBAC: Authorizing `identity:get_project(project_id=b347274669c442b193f5be927dc3bffd)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:53.576278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2610f-f632-4be9-9e45-91922e9a557f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:53.577922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 531/1056] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:45:53 2021] GET /identity/v3/projects/b347274669c442b193f5be927dc3bffd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:53.584895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:53.593590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f81a8-2de7-4736-94a5-a0548c11b27a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:53.598110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:53.599349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:53.599631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:53.600012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:53.600828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=b347274669c442b193f5be927dc3bffd, user.id=b1a14a2e443249af8b59bd4f0526a89f) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:53.601135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:53.602989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d788d-7e41-4d00-91e7-ea94b3087f19 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:53.608670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 526/1057] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:45:53 2021] GET /identity/v3/role_assignments?user.id=b1a14a2e443249af8b59bd4f0526a89f&scope.project.id=b347274669c442b193f5be927dc3bffd&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:55.809773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0840ac-5ade-4282-af5e-7ac5ae20d711 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:55.810337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0840ac-5ade-4282-af5e-7ac5ae20d711 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:55.810337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0840ac-5ade-4282-af5e-7ac5ae20d711 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:55.812148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 532/1058] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:55.818208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:55.818633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:55.819022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:55.836871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:55.838070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:55.845804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 527/1059] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:55.871103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0840ac-5ade-4282-af5e-7ac5ae20d711 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:55.883648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0840ac-5ade-4282-af5e-7ac5ae20d711 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:55.888052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:55.888692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:55.888974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:55.889250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:55.898308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:55.900095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:55.909040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 533/1060] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:45:55 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:45:55.917124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:55.925821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe4bf3-9cd5-4292-98a3-88458bdf40c7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:55.931014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:55.931806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:55.932084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:55.932354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:55.939143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:55.940966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:55.955245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-75c43f81-71eb-467c-b5c1-f3c856b80a9d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 03:45:55.956428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 528/1061] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:45:55 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:45:55.964121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:55.973169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62005800-47c5-421f-86a5-48b722dc8a20 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:55.978483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:55.979164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:55.979445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:55.979733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:55.980432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:45:55.980732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:55.982302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae519a-08ba-4b49-affe-f22b1005127b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:55.989925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 534/1062] 10.222.0.73 () {56 vars in 1137 bytes} [Fri Aug 27 03:45:55 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:45:58.161828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279252a4-f5e5-4c77-bf63-69acf93d01a8 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:58.162395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279252a4-f5e5-4c77-bf63-69acf93d01a8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:58.162395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279252a4-f5e5-4c77-bf63-69acf93d01a8 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:58.164202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 529/1063] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:45:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:45:58.170518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdcfd8-90c8-4418-88c4-88678f1fd833 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:58.170969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdcfd8-90c8-4418-88c4-88678f1fd833 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:58.171102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdcfd8-90c8-4418-88c4-88678f1fd833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:58.188337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-febdcfd8-90c8-4418-88c4-88678f1fd833 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:45:58.189522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-febdcfd8-90c8-4418-88c4-88678f1fd833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:45:58.197570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 535/1064] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:45:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:45:58.222202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279252a4-f5e5-4c77-bf63-69acf93d01a8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:45:58.235185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279252a4-f5e5-4c77-bf63-69acf93d01a8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:45:58.239514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:45:58.240167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:45:58.240449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:45:58.240725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:45:58.241471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:45:58.242474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:45:58.242474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:45:58.242474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:45:58.243391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac9732-0f4d-4bf7-9a7f-6923bfec57e5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:45:58.326657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 530/1065] 10.222.0.73 () {60 vars in 1160 bytes} [Fri Aug 27 03:45:58 2021] POST /identity/v3/domains => generated 267 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:46:00.521161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f1c95-050f-40f5-8ec9-c84943261dfb None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:00.521735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f1c95-050f-40f5-8ec9-c84943261dfb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:00.521830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f1c95-050f-40f5-8ec9-c84943261dfb None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:00.523673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 536/1066] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:46:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:46:00.530016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:00.530512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:00.530646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:00.548574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:46:00.549785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:46:00.607752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 531/1067] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:46:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:46:00.634098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f1c95-050f-40f5-8ec9-c84943261dfb None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:00.646984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f1c95-050f-40f5-8ec9-c84943261dfb None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:00.651419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccc0d2-d0a9-4c87-8878-687cbc013138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:00.652265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccc0d2-d0a9-4c87-8878-687cbc013138 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:00.652546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccc0d2-d0a9-4c87-8878-687cbc013138 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:00.652822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccc0d2-d0a9-4c87-8878-687cbc013138 admin admin] PATH_INFO: `/v3/domains/943816c6c3d146a7947f11d879082bdc` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:00.664052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccc0d2-d0a9-4c87-8878-687cbc013138 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=943816c6c3d146a7947f11d879082bdc)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:00.666283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccc0d2-d0a9-4c87-8878-687cbc013138 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:00.667956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 537/1068] 10.222.0.73 () {56 vars in 1205 bytes} [Fri Aug 27 03:46:00 2021] GET /identity/v3/domains/943816c6c3d146a7947f11d879082bdc => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:00.674756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:00.684482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e88099-2b55-4949-8023-fe7b6dc7054a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:00.689057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7bf2-adda-4afd-94b2-25cbf1b3cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:00.689703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7bf2-adda-4afd-94b2-25cbf1b3cb35 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:00.689982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7bf2-adda-4afd-94b2-25cbf1b3cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:00.690259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7bf2-adda-4afd-94b2-25cbf1b3cb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:00.691005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7bf2-adda-4afd-94b2-25cbf1b3cb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:00.692999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7bf2-adda-4afd-94b2-25cbf1b3cb35 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:00.795298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 532/1069] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:46:00 2021] POST /identity/v3/projects => generated 361 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:46:03.012593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784476c-3cf0-457b-a001-2358972b890e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:03.013154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784476c-3cf0-457b-a001-2358972b890e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:03.013154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784476c-3cf0-457b-a001-2358972b890e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:03.014957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 538/1070] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:46:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:46:03.021914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:03.022387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:03.022490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:03.041217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:46:03.042419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:46:03.100238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 533/1071] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:46:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:46:03.125766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784476c-3cf0-457b-a001-2358972b890e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:03.138634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784476c-3cf0-457b-a001-2358972b890e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:03.142996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4f8e-eadd-4076-aa5b-0b2209094e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:03.143840 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4f8e-eadd-4076-aa5b-0b2209094e4a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:03.144123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4f8e-eadd-4076-aa5b-0b2209094e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:03.144401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4f8e-eadd-4076-aa5b-0b2209094e4a admin admin] PATH_INFO: `/v3/domains/943816c6c3d146a7947f11d879082bdc` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:03.146740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea4f8e-eadd-4076-aa5b-0b2209094e4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=943816c6c3d146a7947f11d879082bdc)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:03.148814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea4f8e-eadd-4076-aa5b-0b2209094e4a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:03.150411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 539/1072] 10.222.0.73 () {56 vars in 1205 bytes} [Fri Aug 27 03:46:03 2021] GET /identity/v3/domains/943816c6c3d146a7947f11d879082bdc => generated 267 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:46:03.156971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:03.166108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bdacd-5a0c-4253-be91-9424c62fb019 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:03.170535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93ae5-ab62-4996-a13e-d4af861ee51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:03.171267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93ae5-ab62-4996-a13e-d4af861ee51e admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:03.171544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93ae5-ab62-4996-a13e-d4af861ee51e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:03.171813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93ae5-ab62-4996-a13e-d4af861ee51e admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:03.172516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a93ae5-ab62-4996-a13e-d4af861ee51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:03.174418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a93ae5-ab62-4996-a13e-d4af861ee51e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:03.257867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 534/1073] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:46:03 2021] POST /identity/v3/users => generated 311 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:46:05.452537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3fd85-cd78-43a3-b974-cfa8777be340 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.453096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3fd85-cd78-43a3-b974-cfa8777be340 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.453096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3fd85-cd78-43a3-b974-cfa8777be340 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.454933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 540/1074] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:46:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:46:05.461648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.462033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.462208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.480218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:46:05.481492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:46:05.489721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 535/1075] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:46:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:46:05.514873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3fd85-cd78-43a3-b974-cfa8777be340 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:05.527152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3fd85-cd78-43a3-b974-cfa8777be340 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:05.531430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:05.532205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.532482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.532750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.543383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:46:05.550004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:46:05.551705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 541/1076] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:46:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:46:05.558639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:05.568149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697151ea-0d10-4f65-a4e6-4f776fabe8ff None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:05.572695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:05.573355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.573636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.573909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.574683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:46:05.574987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:05.576569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:05.585200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 536/1077] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:46:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:05.591787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:05.602078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2ace-0e66-4fa2-8029-4d6b8f405e39 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:05.606727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:05.607588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.607870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.608146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] PATH_INFO: `/v3/users/708ce3f2b4d2425382d464645d0b6662` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.622396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] RBAC: Authorizing `identity:get_user(user_id=708ce3f2b4d2425382d464645d0b6662)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:05.624553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:05.626223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 542/1078] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:46:05 2021] GET /identity/v3/users/708ce3f2b4d2425382d464645d0b6662 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:05.635411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:05.646263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d6b6d-b010-415d-8a21-71019d48fa8c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:05.650764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:05.651408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.651686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.651955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.659927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:05.662212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:05.671277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 537/1079] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:46:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:46:05.678114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:05.687656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c636e9-fb55-4f06-952a-2ad5bd1be239 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:05.692528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fccf54-55c9-4bf2-939d-501cde6b2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:05.693373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fccf54-55c9-4bf2-939d-501cde6b2151 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.693647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fccf54-55c9-4bf2-939d-501cde6b2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.693915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fccf54-55c9-4bf2-939d-501cde6b2151 admin admin] PATH_INFO: `/v3/projects/a901387d35194212be523c347177d6da` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.695114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fccf54-55c9-4bf2-939d-501cde6b2151 admin admin] RBAC: Authorizing `identity:get_project(project_id=a901387d35194212be523c347177d6da)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:05.697334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fccf54-55c9-4bf2-939d-501cde6b2151 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:05.699010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 543/1080] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:46:05 2021] GET /identity/v3/projects/a901387d35194212be523c347177d6da => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:05.705747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:05.715263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592568-34af-47b0-a5b4-6dd2a3868e15 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:05.719876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:05.720530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:05.720815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:05.721091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:05.721912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=a901387d35194212be523c347177d6da, user.id=708ce3f2b4d2425382d464645d0b6662) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:46:05.722222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:05.724737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb4bf-4075-4131-b7c6-4057a327f036 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:05.730154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 538/1081] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:46:05 2021] GET /identity/v3/role_assignments?user.id=708ce3f2b4d2425382d464645d0b6662&scope.project.id=a901387d35194212be523c347177d6da&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:46:07.846315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5b1c-fcdc-482d-8eef-7278d1ef6560 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:07.846881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5b1c-fcdc-482d-8eef-7278d1ef6560 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:07.846881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5b1c-fcdc-482d-8eef-7278d1ef6560 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:07.848723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 544/1082] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:46:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:46:07.855133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:07.855596 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:07.855692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:07.872792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:46:07.873984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:46:07.881592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 539/1083] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:46:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:46:07.906079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5b1c-fcdc-482d-8eef-7278d1ef6560 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:07.919099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5b1c-fcdc-482d-8eef-7278d1ef6560 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:07.923449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:07.924234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:07.924511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:07.924781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:07.935228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:46:07.942078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:46:07.943428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 545/1084] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:46:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:46:07.950376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:07.959918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2ef56-1ee0-455c-a8f4-cb604b0a1ca0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:07.964440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:07.965106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:07.965390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:07.965667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:07.966408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:46:07.966754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:07.968338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:07.977467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 540/1085] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:46:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:07.984097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:07.995290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f58a8-81cc-4616-8d67-5aa29869f8c2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:07.999119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:08.000094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:08.000372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:08.000638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] PATH_INFO: `/v3/users/708ce3f2b4d2425382d464645d0b6662` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:08.001809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] RBAC: Authorizing `identity:get_user(user_id=708ce3f2b4d2425382d464645d0b6662)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:08.003969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:08.005772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 546/1086] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:46:07 2021] GET /identity/v3/users/708ce3f2b4d2425382d464645d0b6662 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:08.012244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:08.022536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c7ab-d100-4d53-a906-5a31ff27793e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:08.027062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a12728-7aa9-44e5-9fb4-62c2852f0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:08.027925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12728-7aa9-44e5-9fb4-62c2852f0df9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:08.028206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12728-7aa9-44e5-9fb4-62c2852f0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:08.028485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12728-7aa9-44e5-9fb4-62c2852f0df9 admin admin] PATH_INFO: `/v3/projects/a901387d35194212be523c347177d6da` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:08.029661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a12728-7aa9-44e5-9fb4-62c2852f0df9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a901387d35194212be523c347177d6da)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:08.031744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a12728-7aa9-44e5-9fb4-62c2852f0df9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:08.033449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 541/1087] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:46:08 2021] GET /identity/v3/projects/a901387d35194212be523c347177d6da => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:08.041465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:08.051740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09a65-3963-42d6-8584-7f4f623ee462 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:08.056251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19329f55-fb11-4ec2-b6a6-a3f46fe74163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:08.057166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19329f55-fb11-4ec2-b6a6-a3f46fe74163 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:08.057473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19329f55-fb11-4ec2-b6a6-a3f46fe74163 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:08.057748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19329f55-fb11-4ec2-b6a6-a3f46fe74163 admin admin] PATH_INFO: `/v3/projects/a901387d35194212be523c347177d6da/users/708ce3f2b4d2425382d464645d0b6662/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:08.059671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19329f55-fb11-4ec2-b6a6-a3f46fe74163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a901387d35194212be523c347177d6da, user_id=708ce3f2b4d2425382d464645d0b6662, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:08.062277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19329f55-fb11-4ec2-b6a6-a3f46fe74163 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:08.142473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 547/1088] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:46:08 2021] PUT /identity/v3/projects/a901387d35194212be523c347177d6da/users/708ce3f2b4d2425382d464645d0b6662/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:46:10.287598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00204f-32f7-434a-a9d1-7380e5b04176 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.288103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00204f-32f7-434a-a9d1-7380e5b04176 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.288103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00204f-32f7-434a-a9d1-7380e5b04176 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.289823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 542/1089] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:46:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:46:10.295928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.296346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.296484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.314327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:46:10.315551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:46:10.371447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 548/1090] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:46:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:46:10.396382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00204f-32f7-434a-a9d1-7380e5b04176 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:10.408165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00204f-32f7-434a-a9d1-7380e5b04176 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:10.413297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:10.414061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.414338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.414642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.424661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:46:10.431875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:46:10.433000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 543/1091] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:46:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:46:10.439733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:10.449012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3e4c3-0df0-4253-9721-657fade32a24 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:10.453540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:10.454201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.454486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.454803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.455549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:46:10.455855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:10.457515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:10.465777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 549/1092] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:46:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:10.471984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:10.482470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03e8b-eea1-4d37-a14d-c1c2d1ec6760 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:10.487018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:10.487860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.488142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.488961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] PATH_INFO: `/v3/users/708ce3f2b4d2425382d464645d0b6662` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.490137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] RBAC: Authorizing `identity:get_user(user_id=708ce3f2b4d2425382d464645d0b6662)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:10.492287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:10.493878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 544/1093] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:46:10 2021] GET /identity/v3/users/708ce3f2b4d2425382d464645d0b6662 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:10.500064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:10.509429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4cbc-26d1-4b4e-8afe-2ac1f91709cc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:10.513882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:10.514513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.514828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.515101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.522788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:10.524525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:10.533005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 550/1094] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:46:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:46:10.540845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:10.550290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f5289-2b82-4ef4-9d65-8439c7de800a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:10.555904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd40c9-6167-4957-aaa9-25fabed2f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:10.556739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd40c9-6167-4957-aaa9-25fabed2f222 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.557023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd40c9-6167-4957-aaa9-25fabed2f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.557303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd40c9-6167-4957-aaa9-25fabed2f222 admin admin] PATH_INFO: `/v3/projects/a901387d35194212be523c347177d6da` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.558459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd40c9-6167-4957-aaa9-25fabed2f222 admin admin] RBAC: Authorizing `identity:get_project(project_id=a901387d35194212be523c347177d6da)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:10.560515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd40c9-6167-4957-aaa9-25fabed2f222 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:10.562169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 545/1095] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:46:10 2021] GET /identity/v3/projects/a901387d35194212be523c347177d6da => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:46:10.568596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:46:10.577102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a8f3-96db-4bd5-afd3-0e2488699be8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:46:10.581599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:46:10.582305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:10.582305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:10.582859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:10.583675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=a901387d35194212be523c347177d6da, user.id=708ce3f2b4d2425382d464645d0b6662) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:46:10.583984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:46:10.585787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865d4d2-fbc3-46cc-86c5-fb89e40a3346 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:46:10.591454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 551/1096] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:46:10 2021] GET /identity/v3/role_assignments?user.id=708ce3f2b4d2425382d464645d0b6662&scope.project.id=a901387d35194212be523c347177d6da&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:28.268658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8c01-d0cb-4ca9-af8b-b1ebb2960282 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:28.269382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8c01-d0cb-4ca9-af8b-b1ebb2960282 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:28.269382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8c01-d0cb-4ca9-af8b-b1ebb2960282 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:28.271040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 546/1097] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:28.276978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:28.277411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:28.277534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:28.295731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:28.296936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:28.305580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 552/1098] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:28.331574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f8c01-d0cb-4ca9-af8b-b1ebb2960282 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:28.346849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f8c01-d0cb-4ca9-af8b-b1ebb2960282 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:28.351236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:28.352046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:28.352328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:28.352602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:28.363697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:28.365517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:28.382921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:28.388148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 547/1099] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:28.390891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:28.399990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06124-ba5e-4fff-9ca7-eae9022ae360 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:28.404748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:28.405726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:28.405726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:28.405936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:28.406696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:28.409600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:28.409600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd4db9-13ab-4555-8ec4-6f0224ac8959 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:28.421697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 553/1100] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:28.429460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:28.439842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada46cc7-ee3a-41dc-b294-d0e938ee1fbe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:28.444233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ce36-d8b6-410e-a85c-e5d0e56cc171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:28.445011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ce36-d8b6-410e-a85c-e5d0e56cc171 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:28.445299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ce36-d8b6-410e-a85c-e5d0e56cc171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:28.445578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ce36-d8b6-410e-a85c-e5d0e56cc171 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:28.446295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ce36-d8b6-410e-a85c-e5d0e56cc171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:28.448241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ce36-d8b6-410e-a85c-e5d0e56cc171 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:28.559895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 548/1101] 10.222.0.73 () {60 vars in 1154 bytes} [Fri Aug 27 03:47:28 2021] POST /identity/v3/users => generated 251 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:47:30.750723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684b94-398d-4afe-b56d-1ab9969490b2 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:30.751251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684b94-398d-4afe-b56d-1ab9969490b2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:30.751251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684b94-398d-4afe-b56d-1ab9969490b2 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:30.753056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 554/1102] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:30.758893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:30.759327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:30.759459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:30.777723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:30.780424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:30.787517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 549/1103] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:30.813166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29684b94-398d-4afe-b56d-1ab9969490b2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:30.826148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29684b94-398d-4afe-b56d-1ab9969490b2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:30.830725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:30.831509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:30.836188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:30.836188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:30.842824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:47:30.850349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:47:30.853686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 555/1104] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:47:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:30.858303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:30.868259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf22fb7-d251-44b6-bb47-eb2d3fc9739d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:30.872826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:30.873529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:30.873800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:30.874077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:30.874866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:30.875179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:30.876774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:30.884883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 550/1105] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:47:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:30.891174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:30.900961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80029b-8518-4eb6-bfb3-8b06809d7a5f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:30.905587 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:30.906376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:30.906686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:30.906957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:30.918762 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:30.920601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:30.938027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:30.940931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 556/1106] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:30.946421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:30.956991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859bc99-82c1-4779-adaf-ac0ba2d05290 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:30.961474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:30.962133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:30.962414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:30.962733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:30.967586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:30.967586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:30.967586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:30.977879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 551/1107] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:30.985026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:30.996049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6fb59-1152-4c20-94bf-696c0cc8e6f0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.000789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.001719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.002025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.002300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.009934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.013589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.025673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:47:31.026847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 557/1108] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:30 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:31.033875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.043896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f6cf2-21cd-4e95-8426-94f818e29701 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.049166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.049836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.050118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.050391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.051259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:31.051569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.053439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.070513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 552/1109] 10.222.0.73 () {56 vars in 1165 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:31.076890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.086954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85fb17-4295-4a1c-abc2-c3081aced2cb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.091452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.092087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.092367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.092639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.101411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.106296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.111850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 558/1110] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:47:31.119033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.129741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f677-87d9-4842-911a-730d11a8cd97 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.134381 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.137158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.137158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.137158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.146330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.148204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.165012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:31.166457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 553/1111] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:47:31.172736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.181471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cffa5b-36c7-46d6-889a-418fd1973c9a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.186035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.186706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.186990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.187259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.187964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:31.188263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.189934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.201045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 559/1112] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:31.208050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.217652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951836d-72e6-411b-a394-0534b13b4a77 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.224206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.229029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.229029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.229029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.232324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.234256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.246982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:47:31.248117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 554/1113] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:31.255450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.263773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411189-8da0-48b8-bf4e-baec31627419 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.268705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.269342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.269619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.269890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.270692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:31.270992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.272821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94beba-3280-4c54-9c0b-172346a29688 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.285102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 560/1114] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:31.291919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:31.302429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56352-f777-4d46-a153-0403b13e3d6b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:31.307011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:31.307643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:31.307925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:31.308200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:31.309018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=4b134c117c9843509b5e8fa587ab484e) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:31.309375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:31.311224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5c79-d3fa-414e-bb3d-22f7f95dbd68 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:31.316510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 555/1115] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:47:31 2021] GET /identity/v3/role_assignments?user.id=4b134c117c9843509b5e8fa587ab484e&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:33.502721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7a62a-1d56-47c9-a091-e3a00772439a None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.503360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7a62a-1d56-47c9-a091-e3a00772439a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.503360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7a62a-1d56-47c9-a091-e3a00772439a None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.505046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 561/1116] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:33.511069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.511492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.511611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.529701 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:33.531128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:33.539082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 556/1117] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:33.565225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7a62a-1d56-47c9-a091-e3a00772439a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.584960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7a62a-1d56-47c9-a091-e3a00772439a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.591894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.593090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.593539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.593981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.609336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:47:33.616979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:47:33.618178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 562/1118] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:33.624886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.636129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fc9e-edc9-4bbc-ae07-ac5a79b823e3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.642610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.642610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.642610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.642610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.643051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:33.643346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.644955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.653442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 557/1119] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:33.660429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.671741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab27e0-4216-4970-bb19-18b8605b2665 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.677069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.677970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.678260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.678538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.689417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.697586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.709167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:33.710407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 563/1120] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:33.718443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.728895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190da8-84bc-4653-8411-cf8834ff0e58 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.733562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.734214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.734492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.734795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.735536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:33.736379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.738163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.751131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 558/1121] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:33.761504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.767542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c13c-eebe-44db-b693-449a514d21e0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.772058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.772843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.773175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.773454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.780790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.783427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.797891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:47:33.799886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 564/1122] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:33.806267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.817258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7073-8f88-470e-aa36-d2d8178871cb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.821994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.822687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.822971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.823282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.824182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:33.824489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.826311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.843777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 559/1123] 10.222.0.73 () {56 vars in 1165 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:33.850831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.860698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3f7cf-6b7d-4ac7-af59-54c509fb4e8c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.866346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.867181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.867458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.867726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.879369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.881225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.898822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:33.900024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 565/1124] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:33.906451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.917148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abfe2c-fbda-4b6e-82e5-1b4a97f77a13 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.921726 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.922373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.922686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.922965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.924389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:33.924694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.926283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.937820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 560/1125] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:33.944728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:33.954805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d9816-726e-47b6-bfbc-cb481253c5c7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:33.959297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:33.960073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:33.967033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:33.967033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:33.967740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:33.969674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:33.983306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:47:33.984484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 566/1126] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:33.991719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:34.001618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab12f-8ace-46d6-8c42-d38b18c7727c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:34.006144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:34.006821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:34.007219 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:34.007502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:34.008282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:34.008592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:34.010421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd6e7f-dedb-40fc-aa4b-cc9f9788aa18 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:34.023351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 561/1127] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:47:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:34.029340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:34.041325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b53f5-87a1-4897-aa3f-ef4349768733 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:34.045970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373af4-99cb-43be-980c-3d2d874b83b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:34.046879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373af4-99cb-43be-980c-3d2d874b83b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:34.047148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373af4-99cb-43be-980c-3d2d874b83b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:34.047424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373af4-99cb-43be-980c-3d2d874b83b7 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/4b134c117c9843509b5e8fa587ab484e/roles/003d930e9fdb435f8b48e26eaa770c7d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:34.062605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373af4-99cb-43be-980c-3d2d874b83b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=4b134c117c9843509b5e8fa587ab484e, role_id=003d930e9fdb435f8b48e26eaa770c7d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:34.065820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373af4-99cb-43be-980c-3d2d874b83b7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:34.203663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 567/1128] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:47:34 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/4b134c117c9843509b5e8fa587ab484e/roles/003d930e9fdb435f8b48e26eaa770c7d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:47:36.335334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45ca2f-6196-4792-853f-2859213c08fe None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.335856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45ca2f-6196-4792-853f-2859213c08fe None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.335856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45ca2f-6196-4792-853f-2859213c08fe None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.337548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 562/1129] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:36.343473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.343853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.344040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.362169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:36.363380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:36.422726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 568/1130] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:36.447354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45ca2f-6196-4792-853f-2859213c08fe None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.459995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45ca2f-6196-4792-853f-2859213c08fe None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.464539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.465321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.465597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.465865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.477250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:47:36.484383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:47:36.485626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 563/1131] 10.222.0.73 () {56 vars in 1124 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:36.493647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.502848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1369-0854-40c0-af67-a23665ec3255 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.508769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.509931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.510456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.510977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.511752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] RBAC: Adding query filter params (name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:36.512065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.513684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.524410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 569/1132] 10.222.0.73 () {56 vars in 1125 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:36.531191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.542390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87e290-ce12-4e18-b8c8-4de109e704f5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.547037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.547812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.548132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.549158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.559356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.561265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.578367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:36.579568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 564/1133] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:36.586881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.596825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b440b-20b0-456d-88a7-1923eca5b2ae admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.601685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.602336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.602649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.602929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.603671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:36.603949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.605541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.617940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 570/1134] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:36.624231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.634698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2145-849b-4e33-82be-6f8e9dd24b95 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.639708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.640629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.640908 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.641180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.649687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.651888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.667388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:47:36.668840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 565/1135] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:36.675478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.685208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7ebc-f1e7-49d4-852d-e352be242623 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.690926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.691594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.691879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.692158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.692998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:36.693308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.695184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.713758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 571/1136] 10.222.0.73 () {56 vars in 1165 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:36.721386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.731209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf2950-7479-4261-81b6-f157bda487b7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.736847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.737497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.737785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.738070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.746289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.748082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.758005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 566/1137] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:47:36.769095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.785450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b317-d4af-40c4-a54d-63dbebbede78 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.792850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.794144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.794656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.795135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.812462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.815941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.846505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:36.848551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 572/1138] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:36.854820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.864518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c725-4392-4862-b9eb-db12b8b3518e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.869349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:36.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.885228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 567/1139] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:36.891492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.901155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66161-ad43-4a8b-960e-8adf46a161c3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.905619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.906396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.906713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.906988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.914125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.916365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.929203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:47:36.930337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 573/1140] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:36.936887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.947528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f328f-78f1-47aa-b6c0-8f19e902aa28 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.952182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.952830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.953115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.953395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.954206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:36.955214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.957170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04960e-9615-416a-9d9b-2341298c0498 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:36.969185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 568/1141] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:36.975799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:36.986251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1f5f-ea6b-4fe5-996c-1948abb7b1c7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:36.990761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:36.991417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:36.991679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:36.991951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:36.992769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] RBAC: Adding query filter params (role.id=003d930e9fdb435f8b48e26eaa770c7d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=4b134c117c9843509b5e8fa587ab484e) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:36.993077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:36.994931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf546e16-4150-437e-b586-d1a3ef540c41 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:37.000911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 574/1142] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:47:36 2021] GET /identity/v3/role_assignments?user.id=4b134c117c9843509b5e8fa587ab484e&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=003d930e9fdb435f8b48e26eaa770c7d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:39.229254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37b31-e0a5-48cc-8963-fbb1b12a1e97 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.229764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37b31-e0a5-48cc-8963-fbb1b12a1e97 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.229764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37b31-e0a5-48cc-8963-fbb1b12a1e97 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.231578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 569/1143] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:39.238094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.238498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.238679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.256274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:39.257454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:39.265120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 575/1144] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:47:39.290272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37b31-e0a5-48cc-8963-fbb1b12a1e97 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.305062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37b31-e0a5-48cc-8963-fbb1b12a1e97 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.309565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.310357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.310669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.310949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.321496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:47:39.328338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:47:39.330075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 570/1145] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:39.337046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.346759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c7801-74a0-479b-a567-ce0ad50ff66e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.351436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.352143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.352366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.352637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.353371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:39.353672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.355300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.363712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 576/1146] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:39.370164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.380835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63aa9-ee21-4823-8270-3f6220b60463 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.385330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.386108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.386392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.386728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.397562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.399444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.417067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:39.418256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 571/1147] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:39.424785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.434645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfbf1d-0818-43f2-a120-1d579412cfe4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.439726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.440487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.440813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.441131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.441925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:39.442293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.444072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.457416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 577/1148] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:39.463816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.474244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a267-edb1-4372-b35b-20ea0806027c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.478965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.479821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.480050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.480325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.488035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.490059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.503968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:47:39.505135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 572/1149] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:39.511851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.522591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eea55-0101-4720-a510-d0c4a379b782 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.527654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.529767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.529767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.529767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.529767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:39.530217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.532348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.551286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 578/1150] 10.222.0.73 () {56 vars in 1165 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:47:39.558012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.568076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cbfcd-1ff1-4dcb-9951-3184d2389e62 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.575886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.576527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.576809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.577156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.587311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.589102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.599164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 573/1151] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:47:39.605765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.616191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349824-b9e9-4681-b466-1f6b41531a6f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.620850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.621637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.621921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.622193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.632920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.634794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.651599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:39.652779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 579/1152] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:39.659361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.668579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab190eb-3195-41ec-a33c-11c94e59302a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.673248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.673903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.674207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.674478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.675413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:39.675766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.677338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.688730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 574/1153] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:39.695850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.705422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7e1ff-1068-433d-b9a3-c9a42d6672e7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.710602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.711377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.711653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.711920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.718448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.720458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.733274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:47:39.734452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 580/1154] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:39.741142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.750886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef840b-4321-435b-b797-2c744957bcc6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.756100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.756753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.757030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.757303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.758079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:39.758385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.760257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6716ed-4786-40d2-adfe-218f2d074755 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.773094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 575/1155] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:39.779818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:39.790080 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7a48-966b-442e-98c6-8faab6f39725 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:39.794909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:39.795543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:39.795827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:39.796103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:39.796921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=4b134c117c9843509b5e8fa587ab484e) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:39.797230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:39.799095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6089e-c43f-436e-acd0-4672b3303fe9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:39.804401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 581/1156] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:47:39 2021] GET /identity/v3/role_assignments?user.id=4b134c117c9843509b5e8fa587ab484e&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:41.950262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd816-4719-4fa6-b250-9d74e62c5aa2 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:41.950842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd816-4719-4fa6-b250-9d74e62c5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:41.950842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd816-4719-4fa6-b250-9d74e62c5aa2 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:41.952623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 576/1157] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:41.958852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:41.959269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:41.959466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:41.977451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:41.978690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:41.991375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 582/1158] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:47:42.015052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bd816-4719-4fa6-b250-9d74e62c5aa2 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.028598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bd816-4719-4fa6-b250-9d74e62c5aa2 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.033271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.034689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.035164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.035443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.047293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:47:42.055468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:47:42.056718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 577/1159] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:42.064384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.075048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cac91b-24a3-44a2-b6f3-c0c1b035c7c9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.079747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.080453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.080742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.081024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.081778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:42.082086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.083741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.092466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 583/1160] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:42.102872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.115014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81686d-2007-4928-85c3-268643c8e705 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.119678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.120467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.120747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.121023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.131779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.133644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.151808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:42.155111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 578/1161] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:42.160168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.170199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda51a4-0a1d-41e9-92f9-95814af62678 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.175574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.178120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.178120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.178120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.178120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:42.178120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.179435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.191552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 584/1162] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:42.198137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.208126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e91d-0555-466f-9b2b-1467c1bfca58 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.212719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.213528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.213804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.214079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.222369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.224438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.239890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:47:42.241103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 579/1163] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:47:42.248086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.260889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173e443-63e5-423c-a328-2c6ca4b305e6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.263263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.264000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.264283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.264586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.265437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:42.265743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.267643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.286725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 585/1164] 10.222.0.73 () {56 vars in 1165 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:42.293433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.303482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130aa2-2726-4671-bc38-02090fe6ffa7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.308142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.308925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.309209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.309488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.320284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.322269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.340544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:42.341761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 580/1165] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:42.349065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.359107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18fefb-2af7-4b38-bac9-a4551e93ec18 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.363730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.364386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.364672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.364951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.365670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:42.365971 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.367646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.379358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 586/1166] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:42.386012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.397294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71932d1f-dd00-4b0f-8bfa-3efbb232f3f2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.402204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.403043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.403328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.403606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.412164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.414182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.428530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:47:42.429733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 581/1167] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:42.436509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.446402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb72f9-2554-4cbf-a063-f69e943bb522 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.451049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.451714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.451995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.452284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.453104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:42.453411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.455918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f7bc-a248-43a0-8f45-5937d9090028 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.468368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 587/1168] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:47:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:47:42.475968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:42.486332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848711-5b21-41cd-9a90-67135a5b9cbc admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:42.493382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9033803-e89d-472b-bf8a-dc4ae1db6761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:42.493382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9033803-e89d-472b-bf8a-dc4ae1db6761 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:42.493382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9033803-e89d-472b-bf8a-dc4ae1db6761 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:42.493382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9033803-e89d-472b-bf8a-dc4ae1db6761 admin admin] PATH_INFO: `/v3/projects/532150cfa2604bf898c920155cb970e8/users/4b134c117c9843509b5e8fa587ab484e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:42.494752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9033803-e89d-472b-bf8a-dc4ae1db6761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532150cfa2604bf898c920155cb970e8, user_id=4b134c117c9843509b5e8fa587ab484e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:42.497370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9033803-e89d-472b-bf8a-dc4ae1db6761 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:42.599556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 582/1169] 10.222.0.73 () {58 vars in 1461 bytes} [Fri Aug 27 03:47:42 2021] PUT /identity/v3/projects/532150cfa2604bf898c920155cb970e8/users/4b134c117c9843509b5e8fa587ab484e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:47:44.876292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d734-33b6-417f-b066-0cda8c7aea2e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:44.876824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d734-33b6-417f-b066-0cda8c7aea2e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:44.876947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d734-33b6-417f-b066-0cda8c7aea2e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:44.879614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 588/1170] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:44.885660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:44.886121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:44.886227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:44.904041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:44.905273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:44.963382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 583/1171] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:44.990344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d734-33b6-417f-b066-0cda8c7aea2e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.003314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d734-33b6-417f-b066-0cda8c7aea2e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.007907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.008695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.008977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.009271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.019904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:47:45.026704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:47:45.027914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 589/1172] 10.222.0.73 () {56 vars in 1118 bytes} [Fri Aug 27 03:47:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:45.035263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.044525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55cdd4-ce9e-468a-8de4-97adcafe6b9b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.049089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.050371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.050691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.050969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.051715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:45.052018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.053599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.062537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 584/1173] 10.222.0.73 () {56 vars in 1121 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:45.069710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.079899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59fba4-9221-45b2-a663-e4cbe8c11174 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.085254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.086028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.086307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.086597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.097212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.099118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.115568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:45.116749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 590/1174] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:45.123346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.133875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589982e8-b953-46f2-87d1-1bee7db1d8b7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.138411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.139101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.139390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.139667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.140385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:45.140690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.142266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.154810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 585/1175] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:45.161757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.171669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e0d1-6f0a-4bde-a042-01c2cf37ce51 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.177130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.177912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.178329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.178454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.185639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.187711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.201429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:47:45.202578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 591/1176] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:45.209102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.218936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72415d0-f550-4a32-8df9-32c036f01759 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.223997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.224668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.224930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.225200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.226019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:45.226322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.228178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.245477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 586/1177] 10.222.0.73 () {56 vars in 1165 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:47:45.251904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.261466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb78e-3946-460d-af51-890b5f4a6d99 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.265924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.266552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.266864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.267136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.275686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.279571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.287058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 592/1178] 10.222.0.73 () {58 vars in 1325 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:47:45.293959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.303807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82833dbe-a5e2-4417-ad81-d8b6833ea2fe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.308446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.309227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.309514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.309793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.319928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.321897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.339051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:47:45.340241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 587/1179] 10.222.0.73 () {56 vars in 1130 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:45.347009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.357224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29d478-e6a3-4018-be36-aec7694d847e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.361860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.362605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.362890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.363162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.363877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:45.364179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.365753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.377107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 593/1180] 10.222.0.73 () {56 vars in 1131 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:45.383531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.393970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec7e2-4638-4ad5-9de3-ceb10f5bc617 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.398751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.399534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.399816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.400093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.407883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.411468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.425382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING keystone.server.flask.application [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:47:45.426580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 588/1181] 10.222.0.73 () {56 vars in 1133 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:45.433328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.443613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420a1c7-cbd3-4e79-a2b7-a3b0a2d8f0bf admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.448720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.449563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.449685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.449950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.450801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:45.451112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.453002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ed63b-57be-4124-9e5a-84755385d4e1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.466329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 594/1182] 10.222.0.73 () {56 vars in 1170 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:45.474551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:45.485362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af6b1e-e10d-415e-8d16-6bb156b215b0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:45.490215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:45.491003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:45.491289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:45.491564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:45.497491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] RBAC: Adding query filter params (role.id=66fa01fc90a4468a8e48a84773bfcd4d, scope.project.id=532150cfa2604bf898c920155cb970e8, user.id=4b134c117c9843509b5e8fa587ab484e) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:45.497491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:45.497491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823ba0-b712-41ae-b2a9-4ee0d598ffe3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:45.500888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 589/1183] 10.222.0.73 () {56 vars in 1396 bytes} [Fri Aug 27 03:47:45 2021] GET /identity/v3/role_assignments?user.id=4b134c117c9843509b5e8fa587ab484e&scope.project.id=532150cfa2604bf898c920155cb970e8&role.id=66fa01fc90a4468a8e48a84773bfcd4d => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:47.751711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e654c2-8d21-4ef3-bd4e-d57a3b4d2d1e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:47.752248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e654c2-8d21-4ef3-bd4e-d57a3b4d2d1e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:47.752248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e654c2-8d21-4ef3-bd4e-d57a3b4d2d1e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:47.754048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 595/1184] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:47.760435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:47.760862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:47.760999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:47.779494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:47.780692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:47.789357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 590/1185] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:47.813379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e654c2-8d21-4ef3-bd4e-d57a3b4d2d1e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:47.825932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e654c2-8d21-4ef3-bd4e-d57a3b4d2d1e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:47.830887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:47.832931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:47.832931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:47.832931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:47.832931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:47.834474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:47.845285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 03:47:47.847035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 596/1186] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:47:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:47.853898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:47.862959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686eb5d2-8f03-4bdb-a831-dd16856cb314 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:47.867576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:47.868235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:47.868521 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:47.868800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:47.869502 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:47.869812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:47.871522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911940-d3f7-4861-92ef-7b602a872e48 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:47.876325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 591/1187] 10.222.0.73 () {56 vars in 1138 bytes} [Fri Aug 27 03:47:47 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:47.883118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:47.893877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936bf62-d14c-4d39-bde4-7c21fac3cb2c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:47.898433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:47.899123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:47.899482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:47.899742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] PATH_INFO: `/v3/services` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:47.900870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:47.901184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:47.902814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2380c-ae2a-4050-bd10-845379d41e1a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:47.907735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 597/1188] 10.222.0.73 () {56 vars in 1138 bytes} [Fri Aug 27 03:47:47 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:50.078275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ec83-ae48-443f-b83b-53e959b98ad6 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:50.078858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ec83-ae48-443f-b83b-53e959b98ad6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:50.078858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ec83-ae48-443f-b83b-53e959b98ad6 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:50.080921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 592/1189] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:50.087079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aee866-28f6-4224-92dd-e40cccbe4640 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:50.092563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aee866-28f6-4224-92dd-e40cccbe4640 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:50.092563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aee866-28f6-4224-92dd-e40cccbe4640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:50.106122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-69aee866-28f6-4224-92dd-e40cccbe4640 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:50.107395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-69aee866-28f6-4224-92dd-e40cccbe4640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:50.115799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 598/1190] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:50.140556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ec83-ae48-443f-b83b-53e959b98ad6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:50.153347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ec83-ae48-443f-b83b-53e959b98ad6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:50.157708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b742a9-e8f7-4a42-9c51-e844c61ad80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:50.158919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b742a9-e8f7-4a42-9c51-e844c61ad80c admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:50.159206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b742a9-e8f7-4a42-9c51-e844c61ad80c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:50.159484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b742a9-e8f7-4a42-9c51-e844c61ad80c admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:50.160248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b742a9-e8f7-4a42-9c51-e844c61ad80c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:50.161831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b742a9-e8f7-4a42-9c51-e844c61ad80c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:50.290387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 593/1191] 10.222.0.73 () {60 vars in 1163 bytes} [Fri Aug 27 03:47:50 2021] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:47:52.490822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f16b-1268-423a-8ebd-2458475e9fe8 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:52.491426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f16b-1268-423a-8ebd-2458475e9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:52.491426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f16b-1268-423a-8ebd-2458475e9fe8 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:52.493212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 599/1192] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:52.499570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:52.500030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:52.500142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:52.519122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:52.520438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:52.537279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 594/1193] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:47:52.561498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f16b-1268-423a-8ebd-2458475e9fe8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:52.574782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f16b-1268-423a-8ebd-2458475e9fe8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:52.579301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:52.580090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:52.581006 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:52.581515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:52.582186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:52.583857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:52.594713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 03:47:52.595890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 600/1194] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:47:52 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:52.603426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:52.612813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76439-6ade-4032-9e0c-db23f503c71a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:52.617418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:52.618087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:52.618371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:52.619258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:52.620452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:52.620771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:52.622471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:52.628556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 595/1195] 10.222.0.73 () {56 vars in 1138 bytes} [Fri Aug 27 03:47:52 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:47:52.635493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:52.646699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eca2e-b5c6-453e-8d44-2039b06aa815 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:52.651415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:52.652119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:52.652400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:52.652676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:52.653462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] RBAC: Adding query filter params (interface=public, service_id=9c9187f9d07d4576876735689a9d1638, region_id=RegionOne) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:52.653771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:52.655389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03adc6f-9bd9-4fbe-ac6d-e4da0dddb3c2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:52.661273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 601/1196] 10.222.0.73 () {56 vars in 1273 bytes} [Fri Aug 27 03:47:52 2021] GET /identity/v3/endpoints?service_id=9c9187f9d07d4576876735689a9d1638&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:52.667916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:52.677680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a3fa0-2974-457d-9e9c-c6ec96542faf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:52.682323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856907-47e0-449f-862e-286b0408c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:52.683005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856907-47e0-449f-862e-286b0408c47e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:52.683287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856907-47e0-449f-862e-286b0408c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:52.683562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856907-47e0-449f-862e-286b0408c47e admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:52.684236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856907-47e0-449f-862e-286b0408c47e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:52.685816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856907-47e0-449f-862e-286b0408c47e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:52.693244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 596/1197] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:47:52 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:47:54.888935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128522c-d2bb-400f-a609-cbdcc7cc07a0 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:54.889569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128522c-d2bb-400f-a609-cbdcc7cc07a0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:54.889569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128522c-d2bb-400f-a609-cbdcc7cc07a0 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:54.891313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 602/1198] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:47:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:47:54.898248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:54.898847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:54.898847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:54.917552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:47:54.918778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:54.926842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 597/1199] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:47:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:47:54.951327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128522c-d2bb-400f-a609-cbdcc7cc07a0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:54.964686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128522c-d2bb-400f-a609-cbdcc7cc07a0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:54.969075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:54.969859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:54.970134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:54.970400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:54.971265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:54.973069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:54.984479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING keystone.server.flask.application [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 03:47:54.985705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 603/1200] 10.222.0.73 () {56 vars in 1139 bytes} [Fri Aug 27 03:47:54 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:47:54.994631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:55.009738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b34e-b246-4a15-9137-3d9f6e189b38 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:55.016805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:55.019148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:55.019148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:55.019477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] PATH_INFO: `/v3/services` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:55.020628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:47:55.021124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:55.023867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c4496-e80e-4bb8-a57b-d0362a364318 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:55.032836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 598/1201] 10.222.0.73 () {56 vars in 1138 bytes} [Fri Aug 27 03:47:54 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:47:55.039637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:55.050191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c18b76-23a1-48bf-a1b3-905ee60b3fd8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:55.054822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83c210-c612-43b9-897f-1f8372e7254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:55.055472 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83c210-c612-43b9-897f-1f8372e7254f admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:55.055756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83c210-c612-43b9-897f-1f8372e7254f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:55.056033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83c210-c612-43b9-897f-1f8372e7254f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:55.056773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83c210-c612-43b9-897f-1f8372e7254f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:55.058364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83c210-c612-43b9-897f-1f8372e7254f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:55.242934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 604/1202] 10.222.0.73 () {60 vars in 1166 bytes} [Fri Aug 27 03:47:55 2021] POST /identity/v3/endpoints => generated 331 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:54:42.111437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b664-ac68-479a-b47b-af4ca10c3024 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:42.112364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b664-ac68-479a-b47b-af4ca10c3024 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:42.112364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b664-ac68-479a-b47b-af4ca10c3024 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:42.113847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 599/1203] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:54:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:42.120600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824d03a-eae5-4845-8c43-b40eacc930fe None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:42.121259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824d03a-eae5-4845-8c43-b40eacc930fe None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:42.121259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824d03a-eae5-4845-8c43-b40eacc930fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:42.198605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6824d03a-eae5-4845-8c43-b40eacc930fe None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:42.199936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6824d03a-eae5-4845-8c43-b40eacc930fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:42.304857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 605/1204] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:54:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:42.330261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b664-ac68-479a-b47b-af4ca10c3024 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:42.332005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-91b6b664-ac68-479a-b47b-af4ca10c3024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:42.547670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b664-ac68-479a-b47b-af4ca10c3024 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:42.677635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9b5aa-49ac-4544-bc3f-de991b1b90ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:42.678575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9b5aa-49ac-4544-bc3f-de991b1b90ad admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:42.679025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9b5aa-49ac-4544-bc3f-de991b1b90ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:42.679459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9b5aa-49ac-4544-bc3f-de991b1b90ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:42.680430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9b5aa-49ac-4544-bc3f-de991b1b90ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:42.682441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9b5aa-49ac-4544-bc3f-de991b1b90ad admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:42.707594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 600/1205] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:54:42 2021] GET /identity/v3/projects => generated 2553 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:54:44.905375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaecac-c74b-455e-acc5-54fe3f670769 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:44.905936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaecac-c74b-455e-acc5-54fe3f670769 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:44.905936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaecac-c74b-455e-acc5-54fe3f670769 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:44.907779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 606/1206] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:54:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:44.913622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c422c3-96b1-4cb9-b00a-47556e1e1464 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:44.914211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c422c3-96b1-4cb9-b00a-47556e1e1464 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:44.914308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c422c3-96b1-4cb9-b00a-47556e1e1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:44.993461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d0c422c3-96b1-4cb9-b00a-47556e1e1464 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:44.994737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d0c422c3-96b1-4cb9-b00a-47556e1e1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:45.093018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 601/1207] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:54:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:45.143739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40394021-6360-402e-952c-3b7ec550c41e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:45.144029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40394021-6360-402e-952c-3b7ec550c41e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:45.144311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40394021-6360-402e-952c-3b7ec550c41e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:45.146100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 607/1208] 10.222.0.73 () {54 vars in 964 bytes} [Fri Aug 27 03:54:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:45.152023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924fdd8-47e9-40ab-936c-e406f1ec4f63 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:45.152318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924fdd8-47e9-40ab-936c-e406f1ec4f63 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:45.152606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924fdd8-47e9-40ab-936c-e406f1ec4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:45.224106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-3924fdd8-47e9-40ab-936c-e406f1ec4f63 None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:45.225241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3924fdd8-47e9-40ab-936c-e406f1ec4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:45.297532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 602/1209] 10.222.0.73 () {58 vars in 1062 bytes} [Fri Aug 27 03:54:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:45.306785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40394021-6360-402e-952c-3b7ec550c41e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:45.308324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-40394021-6360-402e-952c-3b7ec550c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:45.410937 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40394021-6360-402e-952c-3b7ec550c41e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:45.481365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:45.482453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:45.482772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:45.483050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:45.484673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:45.589101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:45.590519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d7f3-ae2e-4395-9ddd-cd465a828c7e service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:45.607903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 608/1210] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:54:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:54:48.023124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fce0da-c877-4910-bc7b-cb0475d3ad4c None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:48.023629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fce0da-c877-4910-bc7b-cb0475d3ad4c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:48.023723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fce0da-c877-4910-bc7b-cb0475d3ad4c None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:48.025454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 603/1211] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:54:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:48.031606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5e5b4-bb4d-4182-b5a3-e16c6117f5cd None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:48.032056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5e5b4-bb4d-4182-b5a3-e16c6117f5cd None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:48.032162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5e5b4-bb4d-4182-b5a3-e16c6117f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:48.096823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-51f5e5b4-bb4d-4182-b5a3-e16c6117f5cd None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:48.098027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-51f5e5b4-bb4d-4182-b5a3-e16c6117f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:48.188313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 609/1212] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:54:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:48.226581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fce0da-c877-4910-bc7b-cb0475d3ad4c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:48.228039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-90fce0da-c877-4910-bc7b-cb0475d3ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:48.330354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fce0da-c877-4910-bc7b-cb0475d3ad4c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:48.401153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:48.401799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:48.402083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:48.402387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:48.405146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:48.510395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:48.511761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e40a-a90c-4791-ba69-fd955cd1eeb2 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:48.529933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 604/1213] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:54:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:54:51.329593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c3c79-1c41-4e37-b59d-4ccca41e5bf1 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:51.330101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c3c79-1c41-4e37-b59d-4ccca41e5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:51.330101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c3c79-1c41-4e37-b59d-4ccca41e5bf1 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:51.331950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 610/1214] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:54:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:51.337861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77678b-a348-492c-b81d-30d70bb71700 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:51.338300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77678b-a348-492c-b81d-30d70bb71700 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:51.338448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77678b-a348-492c-b81d-30d70bb71700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:51.401382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-cc77678b-a348-492c-b81d-30d70bb71700 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:51.402654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cc77678b-a348-492c-b81d-30d70bb71700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:51.495218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 605/1215] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:54:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:51.530141 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c3c79-1c41-4e37-b59d-4ccca41e5bf1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:51.531661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-459c3c79-1c41-4e37-b59d-4ccca41e5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:51.656173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c3c79-1c41-4e37-b59d-4ccca41e5bf1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:51.749056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353af8b6-03a6-4061-9d48-4cc78df7be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:51.751176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353af8b6-03a6-4061-9d48-4cc78df7be16 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:51.751460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353af8b6-03a6-4061-9d48-4cc78df7be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:51.751734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353af8b6-03a6-4061-9d48-4cc78df7be16 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:51.761696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353af8b6-03a6-4061-9d48-4cc78df7be16 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:51.764733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353af8b6-03a6-4061-9d48-4cc78df7be16 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:51.767148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 611/1216] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:54:51 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:54:51.801251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91729e-c04c-4423-889b-271e78ada733 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:51.801537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91729e-c04c-4423-889b-271e78ada733 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:51.801815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91729e-c04c-4423-889b-271e78ada733 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:51.803898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 606/1217] 10.222.0.73 () {54 vars in 964 bytes} [Fri Aug 27 03:54:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:51.812044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f8c9c-35ca-416c-b539-c79a6b5e578b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:51.812336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f8c9c-35ca-416c-b539-c79a6b5e578b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:51.812623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f8c9c-35ca-416c-b539-c79a6b5e578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:51.891043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-406f8c9c-35ca-416c-b539-c79a6b5e578b None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:51.892273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-406f8c9c-35ca-416c-b539-c79a6b5e578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:51.970491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 612/1218] 10.222.0.73 () {58 vars in 1062 bytes} [Fri Aug 27 03:54:51 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:51.984036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91729e-c04c-4423-889b-271e78ada733 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:51.986840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6d91729e-c04c-4423-889b-271e78ada733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:52.092287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91729e-c04c-4423-889b-271e78ada733 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:52.164980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:52.165635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:52.165919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:52.166214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:52.167903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:52.288975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:52.291076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe297e-69ac-49d0-a8da-0f56e7f46fb6 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:52.317347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 607/1219] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:54:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:54:55.790331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c05d4-369f-402a-9226-bbb0b03b46cb None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:55.790925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c05d4-369f-402a-9226-bbb0b03b46cb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:55.790925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c05d4-369f-402a-9226-bbb0b03b46cb None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:55.792704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 613/1220] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:54:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:55.800407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:55.800894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:55.801005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:55.864636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:55.865854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:55.963314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 608/1221] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:54:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:54:55.998129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c05d4-369f-402a-9226-bbb0b03b46cb None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:55.999697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-556c05d4-369f-402a-9226-bbb0b03b46cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:56.125411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c05d4-369f-402a-9226-bbb0b03b46cb None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:56.213677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec1d3-bfc3-4d0d-8ff3-fb9ed5fb1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:56.214450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec1d3-bfc3-4d0d-8ff3-fb9ed5fb1aef admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:56.214759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec1d3-bfc3-4d0d-8ff3-fb9ed5fb1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:56.215031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec1d3-bfc3-4d0d-8ff3-fb9ed5fb1aef admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:56.225192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ec1d3-bfc3-4d0d-8ff3-fb9ed5fb1aef admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:56.227299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ec1d3-bfc3-4d0d-8ff3-fb9ed5fb1aef admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:56.228963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 614/1222] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:54:55 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:54:56.241611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:54:56.242872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:56.330681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a797-033c-4ac3-bb59-92e1604a4c07 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:54:56.399934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:54:56.400576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:56.400855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:56.401126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:56.402821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:56.507031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:54:56.508398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b8bd1-abf1-4ff5-938f-7c1b78502e35 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:54:56.527164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 609/1223] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:54:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:54:59.791725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7479-ee69-4dc9-a5fc-002aae2a046f None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:59.792283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7479-ee69-4dc9-a5fc-002aae2a046f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:59.792283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7479-ee69-4dc9-a5fc-002aae2a046f None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:59.794298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 615/1224] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:54:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:54:59.802007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5662fdc-8fce-43c9-abc1-0e897a9be463 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:54:59.802444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5662fdc-8fce-43c9-abc1-0e897a9be463 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:54:59.802580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5662fdc-8fce-43c9-abc1-0e897a9be463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:54:59.870053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b5662fdc-8fce-43c9-abc1-0e897a9be463 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:54:59.871283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b5662fdc-8fce-43c9-abc1-0e897a9be463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:54:59.974364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 610/1225] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:54:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:00.015817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b7479-ee69-4dc9-a5fc-002aae2a046f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:00.017357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4e0b7479-ee69-4dc9-a5fc-002aae2a046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:00.146999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b7479-ee69-4dc9-a5fc-002aae2a046f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:00.225579 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:00.226144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:00.226425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:00.226728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:00.228559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:00.352767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:00.354218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1e20-7c97-4610-8637-5e430eb6a8bd service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:00.374805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 616/1226] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:02.639398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57086e9-ce4d-478d-a05c-3ce4a1a5877d None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:02.639798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57086e9-ce4d-478d-a05c-3ce4a1a5877d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:02.639965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57086e9-ce4d-478d-a05c-3ce4a1a5877d None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:02.641767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 611/1227] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:02.648057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ee8-fcf3-452f-b144-42c57261025b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:02.648412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ee8-fcf3-452f-b144-42c57261025b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:02.648604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ee8-fcf3-452f-b144-42c57261025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:02.714917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a1ea1ee8-fcf3-452f-b144-42c57261025b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:02.716204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a1ea1ee8-fcf3-452f-b144-42c57261025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:02.809003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 617/1228] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:02.845670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57086e9-ce4d-478d-a05c-3ce4a1a5877d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:02.847436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e57086e9-ce4d-478d-a05c-3ce4a1a5877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:02.949402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57086e9-ce4d-478d-a05c-3ce4a1a5877d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:03.022112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:03.022792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:03.023076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:03.023353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:03.024974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:03.138398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:03.139866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c6e89-153b-4b7f-bb27-20ff1085bc1c service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:03.161298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 612/1229] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:05.424523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b693b-fa17-40c8-bb96-6cfa2b8870d6 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:05.425186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b693b-fa17-40c8-bb96-6cfa2b8870d6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:05.425186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b693b-fa17-40c8-bb96-6cfa2b8870d6 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:05.426882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 618/1230] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:05.432825 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:05.433303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:05.433407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:05.499260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:05.500495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:05.599466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 613/1231] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:55:05.632506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b693b-fa17-40c8-bb96-6cfa2b8870d6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:05.634092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1f9b693b-fa17-40c8-bb96-6cfa2b8870d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:05.776483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b693b-fa17-40c8-bb96-6cfa2b8870d6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:05.879011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06860ec-4565-4a2f-80da-a59654a00177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:05.879879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06860ec-4565-4a2f-80da-a59654a00177 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:05.880170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06860ec-4565-4a2f-80da-a59654a00177 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:05.880437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06860ec-4565-4a2f-80da-a59654a00177 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:05.891030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06860ec-4565-4a2f-80da-a59654a00177 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:05.893226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06860ec-4565-4a2f-80da-a59654a00177 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:05.895031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 619/1232] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:55:05 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:55:05.909112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:05.910510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:06.013298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b86f1c-79b0-43ce-8f37-e8115a5bbe05 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:06.089760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:06.091147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:06.091329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:06.091509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:06.093138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:06.208035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:06.209472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57064a2-d344-4960-a463-d7cee74dc4d6 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:06.228095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 614/1233] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:55:08.939728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6bc5-c5f8-4751-94a6-f14485f8afdc None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:08.940320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6bc5-c5f8-4751-94a6-f14485f8afdc None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:08.940320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6bc5-c5f8-4751-94a6-f14485f8afdc None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:08.942086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 620/1234] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:08.947786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e0aa-0683-4877-bcce-89130c54cd07 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:08.948214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e0aa-0683-4877-bcce-89130c54cd07 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:08.948324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e0aa-0683-4877-bcce-89130c54cd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:09.012541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9eb2e0aa-0683-4877-bcce-89130c54cd07 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:09.013756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9eb2e0aa-0683-4877-bcce-89130c54cd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:09.110929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 615/1235] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:55:09.148131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6bc5-c5f8-4751-94a6-f14485f8afdc None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:09.149646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b53d6bc5-c5f8-4751-94a6-f14485f8afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:09.248614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6bc5-c5f8-4751-94a6-f14485f8afdc None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:09.319572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:09.320216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:09.320502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:09.320778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:09.322383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:09.425689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:09.427173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e75b4-b11b-41a3-83df-09fa17771aa7 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:09.445270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 621/1236] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:11.648666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4c9e-8d42-49b9-a673-34ba14be2c7c None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:11.649233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4c9e-8d42-49b9-a673-34ba14be2c7c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:11.649233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4c9e-8d42-49b9-a673-34ba14be2c7c None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:11.651109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 616/1237] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:11.657736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f87c1-5985-4b7e-a34f-92e7174978ed None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:11.658223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f87c1-5985-4b7e-a34f-92e7174978ed None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:11.658334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f87c1-5985-4b7e-a34f-92e7174978ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:11.726128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3d6f87c1-5985-4b7e-a34f-92e7174978ed None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:11.727380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3d6f87c1-5985-4b7e-a34f-92e7174978ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:11.823802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 622/1238] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:11.865866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc4c9e-8d42-49b9-a673-34ba14be2c7c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:11.867417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-bdcc4c9e-8d42-49b9-a673-34ba14be2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:11.977115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc4c9e-8d42-49b9-a673-34ba14be2c7c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:12.049269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:12.049920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:12.050199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:12.050473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:12.052123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:12.162773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:12.164200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dab71-ce46-44dd-a2dd-ff5d0d97247e service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:12.181788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 617/1239] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:14.992064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c909b-3376-495f-8196-004c79304a4b None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:14.992524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c909b-3376-495f-8196-004c79304a4b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:14.992636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c909b-3376-495f-8196-004c79304a4b None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:14.995678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 623/1240] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:15.001504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a315d-988e-4334-a1e6-f5dc580cdc1d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:15.001931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a315d-988e-4334-a1e6-f5dc580cdc1d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:15.002037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a315d-988e-4334-a1e6-f5dc580cdc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:15.073636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8f8a315d-988e-4334-a1e6-f5dc580cdc1d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:15.074958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8f8a315d-988e-4334-a1e6-f5dc580cdc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:15.184592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 618/1241] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:15.222700 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c909b-3376-495f-8196-004c79304a4b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:15.224801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cc5c909b-3376-495f-8196-004c79304a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:15.322802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c909b-3376-495f-8196-004c79304a4b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:15.327641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c305-5c4f-4f08-9eae-1e46a70eb085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:15.328311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c305-5c4f-4f08-9eae-1e46a70eb085 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:15.328597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c305-5c4f-4f08-9eae-1e46a70eb085 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:15.328877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c305-5c4f-4f08-9eae-1e46a70eb085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:15.343454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878c305-5c4f-4f08-9eae-1e46a70eb085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:15.344929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878c305-5c4f-4f08-9eae-1e46a70eb085 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:15.360709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 624/1242] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:20.234546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a5138-5574-441d-aaff-6dcd659694a6 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:20.235086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a5138-5574-441d-aaff-6dcd659694a6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:20.235202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a5138-5574-441d-aaff-6dcd659694a6 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:20.236903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 619/1243] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:20.243194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c15a-c459-43d8-9190-eb12a736680a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:20.243622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c15a-c459-43d8-9190-eb12a736680a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:20.243622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c15a-c459-43d8-9190-eb12a736680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:20.263019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5881c15a-c459-43d8-9190-eb12a736680a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:20.264224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5881c15a-c459-43d8-9190-eb12a736680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:20.275852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 625/1244] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:20.316614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a5138-5574-441d-aaff-6dcd659694a6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:20.327848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a5138-5574-441d-aaff-6dcd659694a6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:20.331549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297deeb9-3678-498e-8f2c-45c8a3e58d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:20.332326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297deeb9-3678-498e-8f2c-45c8a3e58d7b service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:20.332739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297deeb9-3678-498e-8f2c-45c8a3e58d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:20.333020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297deeb9-3678-498e-8f2c-45c8a3e58d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:20.342802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297deeb9-3678-498e-8f2c-45c8a3e58d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:20.344281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297deeb9-3678-498e-8f2c-45c8a3e58d7b service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:20.353710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 620/1245] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:23.766404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05253f-464c-466e-bd3b-f6e2630c28aa None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:23.766992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05253f-464c-466e-bd3b-f6e2630c28aa None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:23.767159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05253f-464c-466e-bd3b-f6e2630c28aa None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:23.769186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 626/1246] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:23.776147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7959b0-846a-4501-91f5-4ae8b14c8a01 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:23.776710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7959b0-846a-4501-91f5-4ae8b14c8a01 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:23.776812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7959b0-846a-4501-91f5-4ae8b14c8a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:23.797585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6c7959b0-846a-4501-91f5-4ae8b14c8a01 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:23.798875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6c7959b0-846a-4501-91f5-4ae8b14c8a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:23.807129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 621/1247] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:23.850790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05253f-464c-466e-bd3b-f6e2630c28aa None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:23.863636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05253f-464c-466e-bd3b-f6e2630c28aa None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:23.869035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe2b2-3196-42db-bfd3-0f7a4dab7281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:23.869705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe2b2-3196-42db-bfd3-0f7a4dab7281 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:23.870111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe2b2-3196-42db-bfd3-0f7a4dab7281 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:23.870617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe2b2-3196-42db-bfd3-0f7a4dab7281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:23.893317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe2b2-3196-42db-bfd3-0f7a4dab7281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:23.894793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe2b2-3196-42db-bfd3-0f7a4dab7281 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:23.905309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 627/1248] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:28.965845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a181276-b35c-4a5f-8ff4-f1a1ee38b7af None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:28.966433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a181276-b35c-4a5f-8ff4-f1a1ee38b7af None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:28.966433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a181276-b35c-4a5f-8ff4-f1a1ee38b7af None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:28.968195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 622/1249] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:28.975917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28466310-afc2-48bb-a88a-1bb441e50b68 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:28.976365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28466310-afc2-48bb-a88a-1bb441e50b68 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:28.976365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28466310-afc2-48bb-a88a-1bb441e50b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:28.994981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-28466310-afc2-48bb-a88a-1bb441e50b68 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:28.996730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-28466310-afc2-48bb-a88a-1bb441e50b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:29.004615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 628/1250] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:29.048876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a181276-b35c-4a5f-8ff4-f1a1ee38b7af None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:29.060846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a181276-b35c-4a5f-8ff4-f1a1ee38b7af None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:29.064589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff38f-58ce-4f8a-8cc2-dcc4353933a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:29.065255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff38f-58ce-4f8a-8cc2-dcc4353933a8 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:29.065532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff38f-58ce-4f8a-8cc2-dcc4353933a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:29.065804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff38f-58ce-4f8a-8cc2-dcc4353933a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:29.075979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff38f-58ce-4f8a-8cc2-dcc4353933a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:29.077448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff38f-58ce-4f8a-8cc2-dcc4353933a8 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:29.088260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 623/1251] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:35.141714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59693e-35f1-43c2-bd46-168aa2e2f34f None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:35.142128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59693e-35f1-43c2-bd46-168aa2e2f34f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:35.142208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59693e-35f1-43c2-bd46-168aa2e2f34f None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:35.144585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 629/1252] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 03:55:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:35.151107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c994-6529-474f-9094-f83c7b8cecaf None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:35.152739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c994-6529-474f-9094-f83c7b8cecaf None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:35.153237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c994-6529-474f-9094-f83c7b8cecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:35.292815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6599c994-6529-474f-9094-f83c7b8cecaf None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:35.304801 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6599c994-6529-474f-9094-f83c7b8cecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:35.466621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 624/1253] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 03:55:35 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:41.585378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcc01-5bc0-442b-88fe-15b0e50f9d97 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:41.586276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcc01-5bc0-442b-88fe-15b0e50f9d97 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:41.586736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcc01-5bc0-442b-88fe-15b0e50f9d97 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:41.589019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 630/1254] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 03:55:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:55:41.595580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b255cd-efda-4002-a544-1ee150475652 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:41.596466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b255cd-efda-4002-a544-1ee150475652 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:41.596854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b255cd-efda-4002-a544-1ee150475652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:41.619292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-10b255cd-efda-4002-a544-1ee150475652 None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:41.621354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-10b255cd-efda-4002-a544-1ee150475652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:41.632782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 625/1255] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 03:55:41 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:42.811482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba7acd-717a-4e4c-8755-60e2bb2853a0 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:42.812246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba7acd-717a-4e4c-8755-60e2bb2853a0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:42.812246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba7acd-717a-4e4c-8755-60e2bb2853a0 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:42.814259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 631/1256] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 03:55:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:42.822260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5e73-ac33-477b-bb9e-41621a63d83d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:42.822260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5e73-ac33-477b-bb9e-41621a63d83d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:42.822260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5e73-ac33-477b-bb9e-41621a63d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:42.854024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7e2e5e73-ac33-477b-bb9e-41621a63d83d None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:42.856459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7e2e5e73-ac33-477b-bb9e-41621a63d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:42.883584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 626/1257] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 03:55:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:47.637405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd01d-bf97-4611-a52a-7a3b90f34f94 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:47.637977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd01d-bf97-4611-a52a-7a3b90f34f94 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:47.637977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd01d-bf97-4611-a52a-7a3b90f34f94 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:47.640977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 632/1258] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:47 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:47.647975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398a1e-77d3-4163-aa64-7108ba5b7327 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:47.651932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398a1e-77d3-4163-aa64-7108ba5b7327 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:47.651932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398a1e-77d3-4163-aa64-7108ba5b7327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:47.681642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d8398a1e-77d3-4163-aa64-7108ba5b7327 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:47.684736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d8398a1e-77d3-4163-aa64-7108ba5b7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:47.707370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 627/1259] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:47.769161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e06394-e8be-493b-951f-deb1f9423be1 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:47.769705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e06394-e8be-493b-951f-deb1f9423be1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:47.770184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e06394-e8be-493b-951f-deb1f9423be1 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:47.772477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 633/1260] 10.222.0.73 () {54 vars in 961 bytes} [Fri Aug 27 03:55:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:47.779345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0aee4-6d38-4561-aba2-a7c2bc7c30f3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:47.779659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0aee4-6d38-4561-aba2-a7c2bc7c30f3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:47.780260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0aee4-6d38-4561-aba2-a7c2bc7c30f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:47.857351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-07e0aee4-6d38-4561-aba2-a7c2bc7c30f3 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:47.858873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-07e0aee4-6d38-4561-aba2-a7c2bc7c30f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:47.959779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 628/1261] 10.222.0.73 () {58 vars in 1059 bytes} [Fri Aug 27 03:55:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:47.969630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e06394-e8be-493b-951f-deb1f9423be1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:47.985878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e06394-e8be-493b-951f-deb1f9423be1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:47.991821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f4f6-17f9-4b95-aed7-48306e724a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:47.992653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f4f6-17f9-4b95-aed7-48306e724a1f service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:47.996379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f4f6-17f9-4b95-aed7-48306e724a1f service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:47.996379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f4f6-17f9-4b95-aed7-48306e724a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:48.008747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f4f6-17f9-4b95-aed7-48306e724a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:48.011199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f4f6-17f9-4b95-aed7-48306e724a1f service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:48.022984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 634/1262] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:50.500401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cedaef-ddcf-41b9-bc50-92955bf333c0 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:50.500992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cedaef-ddcf-41b9-bc50-92955bf333c0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:50.500992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cedaef-ddcf-41b9-bc50-92955bf333c0 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:50.502959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 629/1263] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:50.509102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927544a-2191-4858-b689-40dfaf7d1f97 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:50.509808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927544a-2191-4858-b689-40dfaf7d1f97 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:50.509808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927544a-2191-4858-b689-40dfaf7d1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:50.530164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8927544a-2191-4858-b689-40dfaf7d1f97 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:50.531536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8927544a-2191-4858-b689-40dfaf7d1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:50.547116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 635/1264] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:50.597506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cedaef-ddcf-41b9-bc50-92955bf333c0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:50.613837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cedaef-ddcf-41b9-bc50-92955bf333c0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:50.619307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b1a90-c8d4-4e95-8f79-ef4647bf0305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:50.620520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b1a90-c8d4-4e95-8f79-ef4647bf0305 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:50.620948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b1a90-c8d4-4e95-8f79-ef4647bf0305 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:50.621295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b1a90-c8d4-4e95-8f79-ef4647bf0305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:50.630162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b1a90-c8d4-4e95-8f79-ef4647bf0305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:50.631776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b1a90-c8d4-4e95-8f79-ef4647bf0305 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:50.642364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 630/1265] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:53.261965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315c43-87ed-482e-9350-2ae8089c99a4 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:53.262491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315c43-87ed-482e-9350-2ae8089c99a4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:53.262491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315c43-87ed-482e-9350-2ae8089c99a4 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:53.267109 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 636/1266] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:53.273574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764d7e1-90a5-4de5-ba6b-1819f8072630 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:53.274014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764d7e1-90a5-4de5-ba6b-1819f8072630 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:53.274130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764d7e1-90a5-4de5-ba6b-1819f8072630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:53.293951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2764d7e1-90a5-4de5-ba6b-1819f8072630 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:53.295266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2764d7e1-90a5-4de5-ba6b-1819f8072630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:53.322599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 631/1267] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:53.364807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd47fdc-b3db-405d-96e3-900a575e165b None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:53.365191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd47fdc-b3db-405d-96e3-900a575e165b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:53.365546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd47fdc-b3db-405d-96e3-900a575e165b None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:53.367520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 637/1268] 10.222.0.73 () {54 vars in 961 bytes} [Fri Aug 27 03:55:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:53.374077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c102-9adb-4d1a-8585-fb1603311d29 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:53.374360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c102-9adb-4d1a-8585-fb1603311d29 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:53.374673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c102-9adb-4d1a-8585-fb1603311d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:53.393802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2b60c102-9adb-4d1a-8585-fb1603311d29 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:53.395045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2b60c102-9adb-4d1a-8585-fb1603311d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:53.404380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 632/1269] 10.222.0.73 () {58 vars in 1059 bytes} [Fri Aug 27 03:55:53 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:55:53.412726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd47fdc-b3db-405d-96e3-900a575e165b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:53.427180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd47fdc-b3db-405d-96e3-900a575e165b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:53.433110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb603-f8ee-49d4-8fbe-cd651a7f4ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:53.433743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb603-f8ee-49d4-8fbe-cd651a7f4ae5 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:53.434024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb603-f8ee-49d4-8fbe-cd651a7f4ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:53.434297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb603-f8ee-49d4-8fbe-cd651a7f4ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:53.442225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb603-f8ee-49d4-8fbe-cd651a7f4ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:53.443867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb603-f8ee-49d4-8fbe-cd651a7f4ae5 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:53.453792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 638/1270] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:55.966969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a376bdb-850e-491b-8970-66cbf44420c8 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:55.967511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a376bdb-850e-491b-8970-66cbf44420c8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:55.967511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a376bdb-850e-491b-8970-66cbf44420c8 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:55.969302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 633/1271] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:55.975696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9593-1c8d-4a31-9b86-7f7a37eafc52 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:55.977186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9593-1c8d-4a31-9b86-7f7a37eafc52 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:55.977668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9593-1c8d-4a31-9b86-7f7a37eafc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.004199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-55ff9593-1c8d-4a31-9b86-7f7a37eafc52 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:56.005872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-55ff9593-1c8d-4a31-9b86-7f7a37eafc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:56.018028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 639/1272] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:56.069739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a376bdb-850e-491b-8970-66cbf44420c8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:56.075886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7442c-d902-48ed-8511-c8ef62d777c4 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:56.076432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7442c-d902-48ed-8511-c8ef62d777c4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:56.076811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7442c-d902-48ed-8511-c8ef62d777c4 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.079084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 640/1273] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:55:56.084897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a376bdb-850e-491b-8970-66cbf44420c8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:56.085067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ac73-5f10-48e6-8904-f7745cb71ff0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:56.085495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ac73-5f10-48e6-8904-f7745cb71ff0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:56.085918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ac73-5f10-48e6-8904-f7745cb71ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.093612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5e38-6703-4c50-9a91-70c6a956f3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:56.094281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5e38-6703-4c50-9a91-70c6a956f3d6 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:56.095384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5e38-6703-4c50-9a91-70c6a956f3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:56.095384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5e38-6703-4c50-9a91-70c6a956f3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.104619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc5e38-6703-4c50-9a91-70c6a956f3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:56.106461 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0cf7ac73-5f10-48e6-8904-f7745cb71ff0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:56.107268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc5e38-6703-4c50-9a91-70c6a956f3d6 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:56.107892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0cf7ac73-5f10-48e6-8904-f7745cb71ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:56.117293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 641/1274] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:55:56.122823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 634/1275] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:55:56.174991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced708b-93e4-404e-a493-3c55708f3eda None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:56.175281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced708b-93e4-404e-a493-3c55708f3eda None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:56.175557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced708b-93e4-404e-a493-3c55708f3eda None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.177344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 642/1276] 10.222.0.73 () {54 vars in 966 bytes} [Fri Aug 27 03:55:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:56.183953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4318b-38e1-414f-85e3-686f708b833f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:56.184323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4318b-38e1-414f-85e3-686f708b833f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:56.184806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4318b-38e1-414f-85e3-686f708b833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.234051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b8f4318b-38e1-414f-85e3-686f708b833f None None] MFA Rules not processed for user `65d84bc451c5469b89788e179bfc4189`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:56.235287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b8f4318b-38e1-414f-85e3-686f708b833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:56.297382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 635/1277] 10.222.0.73 () {58 vars in 1064 bytes} [Fri Aug 27 03:55:56 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:55:56.305307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced708b-93e4-404e-a493-3c55708f3eda None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:56.316640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced708b-93e4-404e-a493-3c55708f3eda None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:56.320222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f27d7-106c-4737-a757-254edc0f00df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:56.327715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f27d7-106c-4737-a757-254edc0f00df service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:56.327715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f27d7-106c-4737-a757-254edc0f00df service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:56.327715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f27d7-106c-4737-a757-254edc0f00df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:56.330543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f27d7-106c-4737-a757-254edc0f00df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:56.332018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f27d7-106c-4737-a757-254edc0f00df service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:56.342202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 643/1278] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:55:58.572894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dbe10-5916-4e07-b0b6-e186de5a6f20 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:58.573721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dbe10-5916-4e07-b0b6-e186de5a6f20 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:58.574009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dbe10-5916-4e07-b0b6-e186de5a6f20 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:58.575912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 636/1279] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:55:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:55:58.582061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0172-e7d5-4137-b4ee-0bc3f67093b8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:58.582508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0172-e7d5-4137-b4ee-0bc3f67093b8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:58.582644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0172-e7d5-4137-b4ee-0bc3f67093b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:58.603191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0c0f0172-e7d5-4137-b4ee-0bc3f67093b8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:55:58.605010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0c0f0172-e7d5-4137-b4ee-0bc3f67093b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:55:58.612894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 644/1280] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:55:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:55:58.660201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dbe10-5916-4e07-b0b6-e186de5a6f20 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:55:58.679056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dbe10-5916-4e07-b0b6-e186de5a6f20 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:55:58.693530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566b78-87ff-412a-b8bb-0a0c104e9a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:55:58.694201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566b78-87ff-412a-b8bb-0a0c104e9a65 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:55:58.694488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566b78-87ff-412a-b8bb-0a0c104e9a65 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:55:58.694812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566b78-87ff-412a-b8bb-0a0c104e9a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:55:58.705120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db566b78-87ff-412a-b8bb-0a0c104e9a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:55:58.706784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db566b78-87ff-412a-b8bb-0a0c104e9a65 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:55:58.720711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 637/1281] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:55:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:01.064501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6415f4-5118-4ef1-9c12-1388f2abcf71 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:01.065433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6415f4-5118-4ef1-9c12-1388f2abcf71 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:01.065877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6415f4-5118-4ef1-9c12-1388f2abcf71 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:01.067852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 645/1282] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:01.074093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c90a7b-3f78-4319-b53c-a43a3257813e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:01.075061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c90a7b-3f78-4319-b53c-a43a3257813e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:01.075191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c90a7b-3f78-4319-b53c-a43a3257813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:01.093658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-37c90a7b-3f78-4319-b53c-a43a3257813e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:01.095056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-37c90a7b-3f78-4319-b53c-a43a3257813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:01.103263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 638/1283] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:01.153126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6415f4-5118-4ef1-9c12-1388f2abcf71 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:01.167464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6415f4-5118-4ef1-9c12-1388f2abcf71 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:01.173224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621860-69bb-4395-84f1-a0c3c4007d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:01.173901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621860-69bb-4395-84f1-a0c3c4007d52 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:01.174182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621860-69bb-4395-84f1-a0c3c4007d52 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:01.174679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621860-69bb-4395-84f1-a0c3c4007d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:01.184605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621860-69bb-4395-84f1-a0c3c4007d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:01.186297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621860-69bb-4395-84f1-a0c3c4007d52 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:01.196887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 646/1284] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:03.617141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12cd16-6e0e-4568-9ce2-00f48a424422 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:03.617623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12cd16-6e0e-4568-9ce2-00f48a424422 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:03.617727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12cd16-6e0e-4568-9ce2-00f48a424422 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:03.622212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 639/1285] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:03.629030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d84312-c6ea-4151-bdaf-1b83b31f0e31 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:03.629475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d84312-c6ea-4151-bdaf-1b83b31f0e31 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:03.629574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d84312-c6ea-4151-bdaf-1b83b31f0e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:03.648773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-56d84312-c6ea-4151-bdaf-1b83b31f0e31 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:03.649978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-56d84312-c6ea-4151-bdaf-1b83b31f0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:03.659648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 647/1286] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:56:03.707854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12cd16-6e0e-4568-9ce2-00f48a424422 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:03.723571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12cd16-6e0e-4568-9ce2-00f48a424422 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:03.729787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6438c1-2ff6-41d5-8fc7-0144d54e6259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:03.730441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6438c1-2ff6-41d5-8fc7-0144d54e6259 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:03.730772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6438c1-2ff6-41d5-8fc7-0144d54e6259 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:03.731056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6438c1-2ff6-41d5-8fc7-0144d54e6259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:03.740074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6438c1-2ff6-41d5-8fc7-0144d54e6259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:03.741836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6438c1-2ff6-41d5-8fc7-0144d54e6259 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:03.752340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 640/1287] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:05.916860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748d01-b778-4394-8c91-aaca09e17562 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:05.917409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748d01-b778-4394-8c91-aaca09e17562 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:05.917409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748d01-b778-4394-8c91-aaca09e17562 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:05.919206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 648/1288] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:05.925419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7771-4c2a-4154-9080-c402e7211215 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:05.925990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7771-4c2a-4154-9080-c402e7211215 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:05.925990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7771-4c2a-4154-9080-c402e7211215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:05.944105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-3a4c7771-4c2a-4154-9080-c402e7211215 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:05.945312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3a4c7771-4c2a-4154-9080-c402e7211215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:05.953148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 641/1289] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:06.000140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748d01-b778-4394-8c91-aaca09e17562 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:06.014497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748d01-b778-4394-8c91-aaca09e17562 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:06.021214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fe3a8-480d-435e-abbb-17ef912c4683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:06.021991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fe3a8-480d-435e-abbb-17ef912c4683 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:06.022358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fe3a8-480d-435e-abbb-17ef912c4683 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:06.022810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fe3a8-480d-435e-abbb-17ef912c4683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:06.034342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fe3a8-480d-435e-abbb-17ef912c4683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:06.036392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fe3a8-480d-435e-abbb-17ef912c4683 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:06.049500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 649/1290] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:08.403624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8d2c-d64a-4a0d-90c0-6e965061b6c6 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:08.404356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8d2c-d64a-4a0d-90c0-6e965061b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:08.404356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8d2c-d64a-4a0d-90c0-6e965061b6c6 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:08.406122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 642/1291] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:08.412302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299b400-65dd-443b-9cf1-f2798448019f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:08.412965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299b400-65dd-443b-9cf1-f2798448019f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:08.412965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299b400-65dd-443b-9cf1-f2798448019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:08.431023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9299b400-65dd-443b-9cf1-f2798448019f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:08.432911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9299b400-65dd-443b-9cf1-f2798448019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:08.440756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 650/1292] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:56:08.488620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8d2c-d64a-4a0d-90c0-6e965061b6c6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:08.504861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8d2c-d64a-4a0d-90c0-6e965061b6c6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:08.511449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf25acb-3460-4362-b847-3d78b45f1c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:08.512131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf25acb-3460-4362-b847-3d78b45f1c39 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:08.512433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf25acb-3460-4362-b847-3d78b45f1c39 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:08.512699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf25acb-3460-4362-b847-3d78b45f1c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:08.521304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf25acb-3460-4362-b847-3d78b45f1c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:08.522924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf25acb-3460-4362-b847-3d78b45f1c39 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:08.532904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 643/1293] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:11.020836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7473c-f68b-4f74-98b7-97886ad8b7e2 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.021390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7473c-f68b-4f74-98b7-97886ad8b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.021390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7473c-f68b-4f74-98b7-97886ad8b7e2 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.023202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 651/1294] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:11.029955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc8da1-b73a-4f53-a992-ae2407110b9f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.030450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc8da1-b73a-4f53-a992-ae2407110b9f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.030553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc8da1-b73a-4f53-a992-ae2407110b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.049667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4fcc8da1-b73a-4f53-a992-ae2407110b9f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:11.050901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4fcc8da1-b73a-4f53-a992-ae2407110b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:11.059947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 644/1295] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:11.108988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7473c-f68b-4f74-98b7-97886ad8b7e2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:11.127066 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7473c-f68b-4f74-98b7-97886ad8b7e2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:11.132829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49fe3-c036-4eb2-9e16-543cef15fab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:11.133497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49fe3-c036-4eb2-9e16-543cef15fab0 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.133779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49fe3-c036-4eb2-9e16-543cef15fab0 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.134055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49fe3-c036-4eb2-9e16-543cef15fab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.143711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49fe3-c036-4eb2-9e16-543cef15fab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:11.145303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49fe3-c036-4eb2-9e16-543cef15fab0 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:11.155614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 652/1296] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:11.474146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209b705-9b7b-4b51-93b6-8458fbf475aa None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.474541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209b705-9b7b-4b51-93b6-8458fbf475aa None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.475408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209b705-9b7b-4b51-93b6-8458fbf475aa None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.477475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 645/1297] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:11.484839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560da92-6a4f-4e4f-8257-ca28c413b833 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.485126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560da92-6a4f-4e4f-8257-ca28c413b833 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.485414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560da92-6a4f-4e4f-8257-ca28c413b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.504644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6560da92-6a4f-4e4f-8257-ca28c413b833 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:11.505885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6560da92-6a4f-4e4f-8257-ca28c413b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:11.513996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 653/1298] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:56:11.576715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60699-3d40-443b-a158-cbc19b848202 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.577005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60699-3d40-443b-a158-cbc19b848202 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.577508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60699-3d40-443b-a158-cbc19b848202 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.579431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 646/1299] 10.222.0.73 () {54 vars in 966 bytes} [Fri Aug 27 03:56:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:11.585943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef67084-d85b-43af-a3a8-ee629f0fd2f6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.586489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef67084-d85b-43af-a3a8-ee629f0fd2f6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.587326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef67084-d85b-43af-a3a8-ee629f0fd2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.645209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3ef67084-d85b-43af-a3a8-ee629f0fd2f6 None None] MFA Rules not processed for user `4f148f069b014ed5baa06b408bab5d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:11.646447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3ef67084-d85b-43af-a3a8-ee629f0fd2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:11.713611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 654/1300] 10.222.0.73 () {58 vars in 1064 bytes} [Fri Aug 27 03:56:11 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:11.721983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade60699-3d40-443b-a158-cbc19b848202 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:11.734180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade60699-3d40-443b-a158-cbc19b848202 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:11.737801 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79d9f-0891-4ad5-a4f9-993911de4415 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:11.738577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79d9f-0891-4ad5-a4f9-993911de4415 service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:11.738917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79d9f-0891-4ad5-a4f9-993911de4415 service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:11.739186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79d9f-0891-4ad5-a4f9-993911de4415 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:11.749985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e79d9f-0891-4ad5-a4f9-993911de4415 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:11.751508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e79d9f-0891-4ad5-a4f9-993911de4415 service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:11.762131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 647/1301] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:12.460710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd552-2e9c-43da-8159-b4933c37a775 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:12.461240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd552-2e9c-43da-8159-b4933c37a775 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:12.461351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd552-2e9c-43da-8159-b4933c37a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:12.512329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b4edd552-2e9c-43da-8159-b4933c37a775 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:12.513566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b4edd552-2e9c-43da-8159-b4933c37a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:12.587472 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 655/1302] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 03:56:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:12.636994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bdadf-5c11-449b-b1a6-4fa5902c3f36 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:12.637540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bdadf-5c11-449b-b1a6-4fa5902c3f36 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:12.637692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bdadf-5c11-449b-b1a6-4fa5902c3f36 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:12.639601 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 648/1303] 10.222.0.73 () {54 vars in 942 bytes} [Fri Aug 27 03:56:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:12.646826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b131-0947-496d-9583-9d05d5f66b94 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:12.647146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b131-0947-496d-9583-9d05d5f66b94 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:12.648209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b131-0947-496d-9583-9d05d5f66b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:12.699951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2591b131-0947-496d-9583-9d05d5f66b94 None None] MFA Rules not processed for user `8946263bd74d445f81944be54ef96070`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:12.701069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2591b131-0947-496d-9583-9d05d5f66b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:12.777033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 656/1304] 10.222.0.73 () {58 vars in 1040 bytes} [Fri Aug 27 03:56:12 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:12.786907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bdadf-5c11-449b-b1a6-4fa5902c3f36 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:12.802156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bdadf-5c11-449b-b1a6-4fa5902c3f36 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:12.808559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ec3cc-0a26-489a-81cd-8467cec82fc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:12.809268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec3cc-0a26-489a-81cd-8467cec82fc5 service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:12.809667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec3cc-0a26-489a-81cd-8467cec82fc5 service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:12.809991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec3cc-0a26-489a-81cd-8467cec82fc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:12.819964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ec3cc-0a26-489a-81cd-8467cec82fc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:12.821870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ec3cc-0a26-489a-81cd-8467cec82fc5 service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:12.830463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 649/1305] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 03:56:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:56:13.593145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0758dc-3b37-4583-882e-0f89479c8600 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:13.595815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0758dc-3b37-4583-882e-0f89479c8600 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:13.595815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0758dc-3b37-4583-882e-0f89479c8600 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:13.596161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 657/1306] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:13.605150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f2a7c-ca60-428d-91ae-98ff3ef8f66f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:13.605480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f2a7c-ca60-428d-91ae-98ff3ef8f66f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:13.605728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f2a7c-ca60-428d-91ae-98ff3ef8f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:13.624572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-739f2a7c-ca60-428d-91ae-98ff3ef8f66f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:13.625800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-739f2a7c-ca60-428d-91ae-98ff3ef8f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:13.637959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 650/1307] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:13.680619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0758dc-3b37-4583-882e-0f89479c8600 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:13.696748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0758dc-3b37-4583-882e-0f89479c8600 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:13.703795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3929e7-4d0b-4faa-9d18-f02b13ee40b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:13.704573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3929e7-4d0b-4faa-9d18-f02b13ee40b2 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:13.704923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3929e7-4d0b-4faa-9d18-f02b13ee40b2 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:13.705272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3929e7-4d0b-4faa-9d18-f02b13ee40b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:13.714390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3929e7-4d0b-4faa-9d18-f02b13ee40b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:13.716115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3929e7-4d0b-4faa-9d18-f02b13ee40b2 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:13.726523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 658/1308] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:16.195842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e94e-2eea-46e6-8105-fb3ba6542fd7 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:16.196446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e94e-2eea-46e6-8105-fb3ba6542fd7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:16.196446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e94e-2eea-46e6-8105-fb3ba6542fd7 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:16.202178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 651/1309] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:16.205544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a29a7-3d92-4f91-983d-c071aeabad24 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:16.206036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a29a7-3d92-4f91-983d-c071aeabad24 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:16.206288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a29a7-3d92-4f91-983d-c071aeabad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:16.225914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-054a29a7-3d92-4f91-983d-c071aeabad24 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:16.229687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-054a29a7-3d92-4f91-983d-c071aeabad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:16.236436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 659/1310] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:56:16.287335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e94e-2eea-46e6-8105-fb3ba6542fd7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:16.303947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e94e-2eea-46e6-8105-fb3ba6542fd7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:16.308901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171760be-97a6-423e-989e-0d3488650117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:16.309567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171760be-97a6-423e-989e-0d3488650117 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:16.309838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171760be-97a6-423e-989e-0d3488650117 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:16.310114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171760be-97a6-423e-989e-0d3488650117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:16.319028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171760be-97a6-423e-989e-0d3488650117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:16.320614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171760be-97a6-423e-989e-0d3488650117 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:16.331061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 652/1311] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:31.568918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeab8a-7152-44d1-8cab-16925214ba61 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:31.569547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeab8a-7152-44d1-8cab-16925214ba61 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:31.569547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeab8a-7152-44d1-8cab-16925214ba61 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:31.571406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 660/1312] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:31.577311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb824bf-591e-46b2-85b2-d40b6a6203d3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:31.577768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb824bf-591e-46b2-85b2-d40b6a6203d3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:31.577873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb824bf-591e-46b2-85b2-d40b6a6203d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:31.596386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2cb824bf-591e-46b2-85b2-d40b6a6203d3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:31.597587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2cb824bf-591e-46b2-85b2-d40b6a6203d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:31.606212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 653/1313] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:56:31.631062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeab8a-7152-44d1-8cab-16925214ba61 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:31.644905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeab8a-7152-44d1-8cab-16925214ba61 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:31.649507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0002b-325f-4c52-83f4-86ab5297b2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:31.650166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0002b-325f-4c52-83f4-86ab5297b2ab admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:31.650449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0002b-325f-4c52-83f4-86ab5297b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:31.650747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0002b-325f-4c52-83f4-86ab5297b2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:31.651475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0002b-325f-4c52-83f4-86ab5297b2ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:31.653341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0002b-325f-4c52-83f4-86ab5297b2ab admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:31.672135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 661/1314] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:56:31 2021] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:56:33.829151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d4cd-b9b8-4ac4-b928-9eb408156c58 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:33.829719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d4cd-b9b8-4ac4-b928-9eb408156c58 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:33.829719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d4cd-b9b8-4ac4-b928-9eb408156c58 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:33.831565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 654/1315] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:33.838500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:33.839041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:33.839150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:33.857737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:33.858989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:33.866807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 662/1316] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:33.894976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d4cd-b9b8-4ac4-b928-9eb408156c58 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:33.908033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d4cd-b9b8-4ac4-b928-9eb408156c58 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:33.912985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:33.913862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:33.914141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:33.914415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] PATH_INFO: `/v3/projects/1312f09679814848855420c41dd2ec09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:33.925482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] RBAC: Authorizing `identity:get_project(project_id=1312f09679814848855420c41dd2ec09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:33.927559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:33.929425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 655/1317] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:33 2021] GET /identity/v3/projects/1312f09679814848855420c41dd2ec09 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:33.937053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:33.946543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09249104-b431-43d7-bc9e-37a12304d394 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:33.951099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:33.951738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:33.952019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:33.952290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:33.953045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] RBAC: Adding query filter params (scope.project.id=1312f09679814848855420c41dd2ec09) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:33.953345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:33.955271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:33.963350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 663/1318] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:33 2021] GET /identity/v3/role_assignments?scope.project.id=1312f09679814848855420c41dd2ec09 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:56:33.969718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:33.980296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b67e-a67b-46f7-9274-6f9769d55741 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:33.984969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609847d9-533f-43d2-a43a-4b09b700ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:33.985830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609847d9-533f-43d2-a43a-4b09b700ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:33.986113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609847d9-533f-43d2-a43a-4b09b700ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:33.986391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609847d9-533f-43d2-a43a-4b09b700ccf8 admin admin] PATH_INFO: `/v3/users/2418235fca724946b472cf4911af5dd3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:34.000611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609847d9-533f-43d2-a43a-4b09b700ccf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2418235fca724946b472cf4911af5dd3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:34.002806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609847d9-533f-43d2-a43a-4b09b700ccf8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:34.004552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 656/1319] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:33 2021] GET /identity/v3/users/2418235fca724946b472cf4911af5dd3 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:34.010992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:34.021304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104b78-2bf8-481c-a75b-5a4b4e8f278b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:34.026724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddc76d-17bd-42a4-8e27-9be75b147f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:34.027587 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddc76d-17bd-42a4-8e27-9be75b147f51 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:34.027868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddc76d-17bd-42a4-8e27-9be75b147f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:34.028146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddc76d-17bd-42a4-8e27-9be75b147f51 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:34.029305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddc76d-17bd-42a4-8e27-9be75b147f51 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:34.031142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddc76d-17bd-42a4-8e27-9be75b147f51 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:34.032782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 664/1320] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:34 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:36.263462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3952c-1e7e-49c9-be44-f877fcbedf60 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:36.264033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3952c-1e7e-49c9-be44-f877fcbedf60 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:36.264033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3952c-1e7e-49c9-be44-f877fcbedf60 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:36.265784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 657/1321] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:56:36.271960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:36.272424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:36.272552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:36.292753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:36.293976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:36.302161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 665/1322] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:36.327765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3952c-1e7e-49c9-be44-f877fcbedf60 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:36.340464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3952c-1e7e-49c9-be44-f877fcbedf60 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:36.344937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:36.345796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:36.346075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:36.346348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] PATH_INFO: `/v3/projects/3953d9945a8c4f53a64136a4286b7dd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:36.358026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3953d9945a8c4f53a64136a4286b7dd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:36.360121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:36.362093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 658/1323] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:36 2021] GET /identity/v3/projects/3953d9945a8c4f53a64136a4286b7dd0 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:36.369518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:36.378718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387db68-854d-4f04-a76b-14c6a44b7772 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:36.384879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:36.385532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:36.385809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:36.386078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:36.386879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] RBAC: Adding query filter params (scope.project.id=3953d9945a8c4f53a64136a4286b7dd0) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:36.387181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:36.389033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:36.396228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 666/1324] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:36 2021] GET /identity/v3/role_assignments?scope.project.id=3953d9945a8c4f53a64136a4286b7dd0 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:56:36.403552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:36.413398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b578f0-4bb6-4d18-add2-b8da541618f1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:36.418047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c63a7-8a14-4c13-b7f1-b300948ea52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:36.419025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c63a7-8a14-4c13-b7f1-b300948ea52b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:36.419300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c63a7-8a14-4c13-b7f1-b300948ea52b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:36.419570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c63a7-8a14-4c13-b7f1-b300948ea52b admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:36.434286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c63a7-8a14-4c13-b7f1-b300948ea52b admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:36.436467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c63a7-8a14-4c13-b7f1-b300948ea52b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:36.438198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 659/1325] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:36 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:56:36.444748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:36.455468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20cec3-74e3-4c7a-9d6c-5ec7ba13011b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:36.460296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cd44-5b1e-483c-97e2-6edcc824a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:36.461201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd44-5b1e-483c-97e2-6edcc824a2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:36.461525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd44-5b1e-483c-97e2-6edcc824a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:36.461924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd44-5b1e-483c-97e2-6edcc824a2e4 admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:36.463748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cd44-5b1e-483c-97e2-6edcc824a2e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:36.465652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cd44-5b1e-483c-97e2-6edcc824a2e4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:36.467305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 667/1326] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:36 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:38.746430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe026ff-e2e6-4361-b0c8-5698086915a5 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:38.747010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe026ff-e2e6-4361-b0c8-5698086915a5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:38.747010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe026ff-e2e6-4361-b0c8-5698086915a5 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:38.748911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 660/1327] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:38.755097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:38.755545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:38.755660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:38.774532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:38.775791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:38.789234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 668/1328] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:38.816807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe026ff-e2e6-4361-b0c8-5698086915a5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:38.829344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe026ff-e2e6-4361-b0c8-5698086915a5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:38.833842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:38.834732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:38.835018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:38.835295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] PATH_INFO: `/v3/projects/83d9ff3d963340b99d57cbb22d01eef9` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:38.846460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] RBAC: Authorizing `identity:get_project(project_id=83d9ff3d963340b99d57cbb22d01eef9)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:38.848580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:38.850383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 661/1329] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:38 2021] GET /identity/v3/projects/83d9ff3d963340b99d57cbb22d01eef9 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:38.859483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:38.869450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858bbe-1df4-4f78-94f1-72b53ab18a06 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:38.873990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:38.874670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:38.874951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:38.875222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:38.875985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] RBAC: Adding query filter params (scope.project.id=83d9ff3d963340b99d57cbb22d01eef9) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:38.876285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:38.878118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b824a-6d1c-453f-8318-086a28e3571b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:38.884735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 669/1330] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:38 2021] GET /identity/v3/role_assignments?scope.project.id=83d9ff3d963340b99d57cbb22d01eef9 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:38.891393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:38.902151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4565bb-c181-4312-8ff7-cd62b9187e17 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:38.907405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41fc5-69b1-4d8a-bdfd-87d9c9ce7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:38.908303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41fc5-69b1-4d8a-bdfd-87d9c9ce7087 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:38.908720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41fc5-69b1-4d8a-bdfd-87d9c9ce7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:38.909159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41fc5-69b1-4d8a-bdfd-87d9c9ce7087 admin admin] PATH_INFO: `/v3/users/ce757ce3882c4a3787f07fc82ba39a09` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:38.910027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41fc5-69b1-4d8a-bdfd-87d9c9ce7087 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce757ce3882c4a3787f07fc82ba39a09)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:38.912210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41fc5-69b1-4d8a-bdfd-87d9c9ce7087 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:38.914080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 662/1331] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:38 2021] GET /identity/v3/users/ce757ce3882c4a3787f07fc82ba39a09 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:41.150040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81562d4e-d56f-40f0-a91b-d2d363bb8858 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:41.150641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81562d4e-d56f-40f0-a91b-d2d363bb8858 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:41.150641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81562d4e-d56f-40f0-a91b-d2d363bb8858 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:41.152388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 670/1332] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:41.158174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:41.158632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:41.158790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:41.177453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:41.178692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:41.187392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 663/1333] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:41.212918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81562d4e-d56f-40f0-a91b-d2d363bb8858 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:41.223374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81562d4e-d56f-40f0-a91b-d2d363bb8858 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:41.228705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:41.229549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:41.229835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:41.230128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] PATH_INFO: `/v3/projects/a3fb454a96cf4135a4a2d39185c4902e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:41.240767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3fb454a96cf4135a4a2d39185c4902e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:41.244028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:41.245786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 671/1334] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:41 2021] GET /identity/v3/projects/a3fb454a96cf4135a4a2d39185c4902e => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:41.252628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:41.261873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63723a-fe5b-42f6-8bbd-349081a98131 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:41.266458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:41.272337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:41.272337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:41.272337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:41.272337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] RBAC: Adding query filter params (scope.project.id=a3fb454a96cf4135a4a2d39185c4902e) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:41.272337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:41.272337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:41.277643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 664/1335] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:41 2021] GET /identity/v3/role_assignments?scope.project.id=a3fb454a96cf4135a4a2d39185c4902e => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:41.283919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:41.294390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50203-67ff-4dc8-8fe5-d85a83d243e9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:41.299389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8ff9-ccdd-41f4-9494-8eb6a6899807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:41.300255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8ff9-ccdd-41f4-9494-8eb6a6899807 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:41.300541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8ff9-ccdd-41f4-9494-8eb6a6899807 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:41.300822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8ff9-ccdd-41f4-9494-8eb6a6899807 admin admin] PATH_INFO: `/v3/users/62f9c05257a64b5ca259c9df6faa65d8` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:41.315498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8ff9-ccdd-41f4-9494-8eb6a6899807 admin admin] RBAC: Authorizing `identity:get_user(user_id=62f9c05257a64b5ca259c9df6faa65d8)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:41.317657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8ff9-ccdd-41f4-9494-8eb6a6899807 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:41.319400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 672/1336] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:41 2021] GET /identity/v3/users/62f9c05257a64b5ca259c9df6faa65d8 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:41.325534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:41.335130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd6a8-004d-4bea-8629-2a780d21e5a6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:41.340676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b15e5-366d-4378-8c4f-2451f45d338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:41.341532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b15e5-366d-4378-8c4f-2451f45d338b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:41.341811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b15e5-366d-4378-8c4f-2451f45d338b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:41.342082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b15e5-366d-4378-8c4f-2451f45d338b admin admin] PATH_INFO: `/v3/users/b29823f852e6418da3c59aa61fd53516` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:41.356390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b15e5-366d-4378-8c4f-2451f45d338b admin admin] RBAC: Authorizing `identity:get_user(user_id=b29823f852e6418da3c59aa61fd53516)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:41.358533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b15e5-366d-4378-8c4f-2451f45d338b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:41.360270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 665/1337] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:41 2021] GET /identity/v3/users/b29823f852e6418da3c59aa61fd53516 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:43.683566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf50081-89d8-4bfc-b2f2-795ea763f9a7 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:43.684133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf50081-89d8-4bfc-b2f2-795ea763f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:43.684133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf50081-89d8-4bfc-b2f2-795ea763f9a7 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:43.685907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 673/1338] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:43.692065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:43.692527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:43.692651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:43.712604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:43.713853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:43.721785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 666/1339] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:43.747958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf50081-89d8-4bfc-b2f2-795ea763f9a7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:43.760962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf50081-89d8-4bfc-b2f2-795ea763f9a7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:43.765425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:43.766287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:43.766589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:43.766861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] PATH_INFO: `/v3/projects/a901387d35194212be523c347177d6da` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:43.779028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] RBAC: Authorizing `identity:get_project(project_id=a901387d35194212be523c347177d6da)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:43.781110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:43.782874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 674/1340] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:43 2021] GET /identity/v3/projects/a901387d35194212be523c347177d6da => generated 361 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:43.790802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:43.799686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04395ce-b73c-4777-bce0-d796cc49523f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:43.804293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:43.805551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:43.806213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:43.806213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:43.806922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] RBAC: Adding query filter params (scope.project.id=a901387d35194212be523c347177d6da) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:43.807227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:43.809066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975d15-32b1-45e2-afe8-3247238dc75d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:43.814648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 667/1341] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:43 2021] GET /identity/v3/role_assignments?scope.project.id=a901387d35194212be523c347177d6da => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:43.821863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:43.831926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693f14-178a-4c00-8567-ef0a7b86a22d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:43.836696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae039-c5ac-497b-a1a7-6ebf65ec7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:43.837395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae039-c5ac-497b-a1a7-6ebf65ec7a15 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:43.837675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae039-c5ac-497b-a1a7-6ebf65ec7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:43.837946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae039-c5ac-497b-a1a7-6ebf65ec7a15 admin admin] PATH_INFO: `/v3/users/708ce3f2b4d2425382d464645d0b6662` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:43.851518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae039-c5ac-497b-a1a7-6ebf65ec7a15 admin admin] RBAC: Authorizing `identity:get_user(user_id=708ce3f2b4d2425382d464645d0b6662)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:43.853704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae039-c5ac-497b-a1a7-6ebf65ec7a15 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:43.855665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 675/1342] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:43 2021] GET /identity/v3/users/708ce3f2b4d2425382d464645d0b6662 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:46.062348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8987c-88de-40aa-ae82-b78e4a6f0cb5 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:46.062922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8987c-88de-40aa-ae82-b78e4a6f0cb5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:46.062922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8987c-88de-40aa-ae82-b78e4a6f0cb5 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:46.064623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 668/1343] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:46.071050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:46.071481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:46.071481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:46.090172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:46.091432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:46.099355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 676/1344] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:46.124648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8987c-88de-40aa-ae82-b78e4a6f0cb5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:46.138427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8987c-88de-40aa-ae82-b78e4a6f0cb5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:46.143069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:46.143922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:46.144225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:46.144497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] PATH_INFO: `/v3/projects/b347274669c442b193f5be927dc3bffd` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:46.156712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] RBAC: Authorizing `identity:get_project(project_id=b347274669c442b193f5be927dc3bffd)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:46.158802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:46.160561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 669/1345] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:46 2021] GET /identity/v3/projects/b347274669c442b193f5be927dc3bffd => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:46.167327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:46.177025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdee3f-b64a-4250-962c-4e6aab602a0a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:46.183670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:46.183670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:46.183670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:46.183951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:46.184526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] RBAC: Adding query filter params (scope.project.id=b347274669c442b193f5be927dc3bffd) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:46.184832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:46.186721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783dcf-050a-4bc0-8fb2-9d5c08480f25 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:46.192595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 677/1346] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:46 2021] GET /identity/v3/role_assignments?scope.project.id=b347274669c442b193f5be927dc3bffd => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:46.199980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:46.210338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0875-3965-4ee1-83b8-75a60e699715 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:46.215585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572501e5-3226-44cf-98ca-3ea1d3b8e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:46.216466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572501e5-3226-44cf-98ca-3ea1d3b8e45a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:46.216744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572501e5-3226-44cf-98ca-3ea1d3b8e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:46.217017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572501e5-3226-44cf-98ca-3ea1d3b8e45a admin admin] PATH_INFO: `/v3/users/b1a14a2e443249af8b59bd4f0526a89f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:46.232461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572501e5-3226-44cf-98ca-3ea1d3b8e45a admin admin] RBAC: Authorizing `identity:get_user(user_id=b1a14a2e443249af8b59bd4f0526a89f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:46.234629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572501e5-3226-44cf-98ca-3ea1d3b8e45a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:46.236553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 670/1347] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:46 2021] GET /identity/v3/users/b1a14a2e443249af8b59bd4f0526a89f => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:48.481885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7432-0ec0-4ffb-8455-394382470c71 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:48.482432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7432-0ec0-4ffb-8455-394382470c71 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:48.482432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7432-0ec0-4ffb-8455-394382470c71 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:48.484240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 678/1348] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:48.490267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:48.490750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:48.490852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:48.509071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:48.510277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:48.519113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 671/1349] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:48.544137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd7432-0ec0-4ffb-8455-394382470c71 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:48.558417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd7432-0ec0-4ffb-8455-394382470c71 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:48.562964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:48.563825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:48.564108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:48.564406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] PATH_INFO: `/v3/projects/d619747d92dd4ce8a23a9280f1833108` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:48.565570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d619747d92dd4ce8a23a9280f1833108)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:48.568122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:48.569776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 679/1350] 10.222.0.73 () {56 vars in 1208 bytes} [Fri Aug 27 03:56:48 2021] GET /identity/v3/projects/d619747d92dd4ce8a23a9280f1833108 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:48.577195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:48.587033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8177d-98dd-4600-9e79-acc9786d3fff None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:48.591678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:48.592522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:48.592655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:48.592861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:48.593625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] RBAC: Adding query filter params (scope.project.id=d619747d92dd4ce8a23a9280f1833108) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:56:48.593929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:48.595817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918b455-d3aa-4b3a-9b1b-dfcbac68f399 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:48.602059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 672/1351] 10.222.0.73 () {56 vars in 1232 bytes} [Fri Aug 27 03:56:48 2021] GET /identity/v3/role_assignments?scope.project.id=d619747d92dd4ce8a23a9280f1833108 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:48.608723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:48.618471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86cc31-5ec2-44d4-982c-119f46a903f5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:48.623360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb7bd4-6b7d-4de0-b487-96223243b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:48.624224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7bd4-6b7d-4de0-b487-96223243b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:48.624507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7bd4-6b7d-4de0-b487-96223243b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:48.624784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb7bd4-6b7d-4de0-b487-96223243b6bc admin admin] PATH_INFO: `/v3/users/d7499c7d953346c79b8adf6b0557fa02` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:48.625954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb7bd4-6b7d-4de0-b487-96223243b6bc admin admin] RBAC: Authorizing `identity:get_user(user_id=d7499c7d953346c79b8adf6b0557fa02)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:48.627838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb7bd4-6b7d-4de0-b487-96223243b6bc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:48.629450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 680/1352] 10.222.0.73 () {56 vars in 1199 bytes} [Fri Aug 27 03:56:48 2021] GET /identity/v3/users/d7499c7d953346c79b8adf6b0557fa02 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:56:54.241367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685af9a-cec4-45bf-a950-0ca4dd3fc8d6 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:54.241962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685af9a-cec4-45bf-a950-0ca4dd3fc8d6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:54.241962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685af9a-cec4-45bf-a950-0ca4dd3fc8d6 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:54.244500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 673/1353] 10.222.0.73 () {54 vars in 918 bytes} [Fri Aug 27 03:56:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:54.255516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5213-be48-466b-b463-053f839e8331 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:54.256041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5213-be48-466b-b463-053f839e8331 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:54.256041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5213-be48-466b-b463-053f839e8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:54.281318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e32a5213-be48-466b-b463-053f839e8331 None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:54.282534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e32a5213-be48-466b-b463-053f839e8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:54.292903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 681/1354] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 27 03:56:54 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:54.312441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3959-d19e-49c6-b6c3-0b81017b745e None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:54.312742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3959-d19e-49c6-b6c3-0b81017b745e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:54.312996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3959-d19e-49c6-b6c3-0b81017b745e None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:54.314862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 674/1355] 10.222.0.73 () {54 vars in 918 bytes} [Fri Aug 27 03:56:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:54.321443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e853b3-f161-4d8e-9fa1-452796ee0bdc None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:54.321725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e853b3-f161-4d8e-9fa1-452796ee0bdc None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:54.322002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e853b3-f161-4d8e-9fa1-452796ee0bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:54.344074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-60e853b3-f161-4d8e-9fa1-452796ee0bdc None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:54.345343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-60e853b3-f161-4d8e-9fa1-452796ee0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:54.357694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 682/1356] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 27 03:56:54 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:57.238449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a4b9b-51f0-494e-992b-bf6f9d01e257 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:57.239069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a4b9b-51f0-494e-992b-bf6f9d01e257 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:57.239069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a4b9b-51f0-494e-992b-bf6f9d01e257 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:57.240713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 675/1357] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:56:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:57.247038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260dd2a-5cd3-4687-81be-1c51dbf6a98e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:57.247490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260dd2a-5cd3-4687-81be-1c51dbf6a98e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:57.247629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260dd2a-5cd3-4687-81be-1c51dbf6a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:57.265334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5260dd2a-5cd3-4687-81be-1c51dbf6a98e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:57.266545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5260dd2a-5cd3-4687-81be-1c51dbf6a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:57.274854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 683/1358] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:56:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:57.318612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a4b9b-51f0-494e-992b-bf6f9d01e257 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:57.333261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a4b9b-51f0-494e-992b-bf6f9d01e257 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:57.339392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4e39-79e3-425d-8eb8-f16a59084743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:57.340038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4e39-79e3-425d-8eb8-f16a59084743 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:57.340333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4e39-79e3-425d-8eb8-f16a59084743 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:57.340603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4e39-79e3-425d-8eb8-f16a59084743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:57.349054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4e39-79e3-425d-8eb8-f16a59084743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:57.350668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4e39-79e3-425d-8eb8-f16a59084743 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:57.360820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 676/1359] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:58.788380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3d142-bc3c-4853-9540-6f21cfc04702 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:58.789590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3d142-bc3c-4853-9540-6f21cfc04702 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:58.790363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3d142-bc3c-4853-9540-6f21cfc04702 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:58.792200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 684/1360] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:56:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:56:58.798194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba272-a45e-4fdd-82ad-f493aa6a6d68 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:58.798695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba272-a45e-4fdd-82ad-f493aa6a6d68 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:58.798797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba272-a45e-4fdd-82ad-f493aa6a6d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:58.816306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d80ba272-a45e-4fdd-82ad-f493aa6a6d68 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:56:58.817519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d80ba272-a45e-4fdd-82ad-f493aa6a6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:56:58.825631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 677/1361] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:56:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:56:58.984058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3d142-bc3c-4853-9540-6f21cfc04702 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:56:58.997975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3d142-bc3c-4853-9540-6f21cfc04702 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:56:59.003281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62204-4042-4622-bb16-82e4f4f139bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:56:59.003919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62204-4042-4622-bb16-82e4f4f139bd service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:56:59.004198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62204-4042-4622-bb16-82e4f4f139bd service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:56:59.004474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62204-4042-4622-bb16-82e4f4f139bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:56:59.013493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d62204-4042-4622-bb16-82e4f4f139bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:56:59.015096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d62204-4042-4622-bb16-82e4f4f139bd service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:56:59.024786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 685/1362] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:56:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:00.442317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641bf4b-2455-4341-95a2-452743917412 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:00.442931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641bf4b-2455-4341-95a2-452743917412 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:00.442931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641bf4b-2455-4341-95a2-452743917412 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:00.444645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 678/1363] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:00.450822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef91b27-eed0-4eef-b9be-29688fe25dae None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:00.451223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef91b27-eed0-4eef-b9be-29688fe25dae None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:00.451380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef91b27-eed0-4eef-b9be-29688fe25dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:00.469165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0ef91b27-eed0-4eef-b9be-29688fe25dae None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:00.470346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0ef91b27-eed0-4eef-b9be-29688fe25dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:00.478076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 686/1364] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:00.630951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641bf4b-2455-4341-95a2-452743917412 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:00.646270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641bf4b-2455-4341-95a2-452743917412 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:00.652315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720605-195d-4d4b-bc5f-80291e0e089d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:00.652951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720605-195d-4d4b-bc5f-80291e0e089d service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:00.653233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720605-195d-4d4b-bc5f-80291e0e089d service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:00.653508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720605-195d-4d4b-bc5f-80291e0e089d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:00.661400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27720605-195d-4d4b-bc5f-80291e0e089d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:00.663004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27720605-195d-4d4b-bc5f-80291e0e089d service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:00.672437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 679/1365] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:02.070823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53211d78-47f1-477d-a1ca-2317b59f4920 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:02.071342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53211d78-47f1-477d-a1ca-2317b59f4920 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:02.071342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53211d78-47f1-477d-a1ca-2317b59f4920 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:02.073084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 687/1366] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:02.078635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3a5c-eae9-4215-8af8-25a00f0e6540 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:02.079075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3a5c-eae9-4215-8af8-25a00f0e6540 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:02.079213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3a5c-eae9-4215-8af8-25a00f0e6540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:02.098722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-71ba3a5c-eae9-4215-8af8-25a00f0e6540 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:02.099931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-71ba3a5c-eae9-4215-8af8-25a00f0e6540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:02.108727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 680/1367] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:57:02.262491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53211d78-47f1-477d-a1ca-2317b59f4920 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:02.276616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53211d78-47f1-477d-a1ca-2317b59f4920 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:02.281896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5d1a-a878-4992-b886-73b54a1fdb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:02.282658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5d1a-a878-4992-b886-73b54a1fdb7d service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:02.282936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5d1a-a878-4992-b886-73b54a1fdb7d service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:02.283208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5d1a-a878-4992-b886-73b54a1fdb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:02.291537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5d1a-a878-4992-b886-73b54a1fdb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:02.293094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5d1a-a878-4992-b886-73b54a1fdb7d service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:02.302515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 688/1368] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:03.686423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0405b1f-b126-4a7e-97d3-00a4031246c9 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:03.687021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0405b1f-b126-4a7e-97d3-00a4031246c9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:03.687021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0405b1f-b126-4a7e-97d3-00a4031246c9 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:03.688828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 681/1369] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:03.694335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde0c0-2564-483f-9ee0-84e9fddf213a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:03.694799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde0c0-2564-483f-9ee0-84e9fddf213a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:03.695059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdde0c0-2564-483f-9ee0-84e9fddf213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:03.712323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ffdde0c0-2564-483f-9ee0-84e9fddf213a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:03.713498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ffdde0c0-2564-483f-9ee0-84e9fddf213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:03.721043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 689/1370] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:03.877076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0405b1f-b126-4a7e-97d3-00a4031246c9 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:03.891136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0405b1f-b126-4a7e-97d3-00a4031246c9 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:03.896401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cf6bd-c135-4209-8e7b-303431d13311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:03.897030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cf6bd-c135-4209-8e7b-303431d13311 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:03.897311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cf6bd-c135-4209-8e7b-303431d13311 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:03.897612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cf6bd-c135-4209-8e7b-303431d13311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:03.906232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cf6bd-c135-4209-8e7b-303431d13311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:03.907837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cf6bd-c135-4209-8e7b-303431d13311 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:03.917632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 682/1371] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:05.294869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b3c75-9389-46a8-9a18-fdedc4607260 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:05.295396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b3c75-9389-46a8-9a18-fdedc4607260 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:05.295396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b3c75-9389-46a8-9a18-fdedc4607260 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:05.297457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 690/1372] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:05.303009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e096-6030-4e73-a23b-d206c1caf46c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:05.303436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e096-6030-4e73-a23b-d206c1caf46c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:05.303545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e096-6030-4e73-a23b-d206c1caf46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:05.322286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-53a1e096-6030-4e73-a23b-d206c1caf46c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:05.323519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-53a1e096-6030-4e73-a23b-d206c1caf46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:05.331250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 683/1373] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:05.482428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b3c75-9389-46a8-9a18-fdedc4607260 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:05.496550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b3c75-9389-46a8-9a18-fdedc4607260 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:05.501868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f987c-9d74-427c-b251-031e53326622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:05.502502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f987c-9d74-427c-b251-031e53326622 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:05.502826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f987c-9d74-427c-b251-031e53326622 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:05.503100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f987c-9d74-427c-b251-031e53326622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:05.511454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f987c-9d74-427c-b251-031e53326622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:05.513032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f987c-9d74-427c-b251-031e53326622 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:05.522217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 691/1374] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:06.935856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaff41f-baf5-4eca-a911-23ba166cf67f None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:06.936421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaff41f-baf5-4eca-a911-23ba166cf67f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:06.936421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaff41f-baf5-4eca-a911-23ba166cf67f None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:06.938203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 684/1375] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:06.943763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902b7ea-af87-4fcb-b031-26e387f2825f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:06.944206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902b7ea-af87-4fcb-b031-26e387f2825f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:06.944334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902b7ea-af87-4fcb-b031-26e387f2825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:06.962283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7902b7ea-af87-4fcb-b031-26e387f2825f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:06.963520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7902b7ea-af87-4fcb-b031-26e387f2825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:06.971237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 692/1376] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:07.125063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaff41f-baf5-4eca-a911-23ba166cf67f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:07.139844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaff41f-baf5-4eca-a911-23ba166cf67f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:07.145299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a70875-e873-48bb-a602-9c62e1d9c80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:07.145940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70875-e873-48bb-a602-9c62e1d9c80a service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:07.146222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70875-e873-48bb-a602-9c62e1d9c80a service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:07.146497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a70875-e873-48bb-a602-9c62e1d9c80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:07.154397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a70875-e873-48bb-a602-9c62e1d9c80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:07.156002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a70875-e873-48bb-a602-9c62e1d9c80a service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:07.165685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 685/1377] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:08.629757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c13a-04c9-44ce-813e-b3c97dead45f None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:08.630292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c13a-04c9-44ce-813e-b3c97dead45f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:08.630292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c13a-04c9-44ce-813e-b3c97dead45f None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:08.633912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 693/1378] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:08.639631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf9c66-8cc1-41e0-86e8-1ad00d3e4993 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:08.640105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf9c66-8cc1-41e0-86e8-1ad00d3e4993 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:08.640198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf9c66-8cc1-41e0-86e8-1ad00d3e4993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:08.658072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5acf9c66-8cc1-41e0-86e8-1ad00d3e4993 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:08.659348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5acf9c66-8cc1-41e0-86e8-1ad00d3e4993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:08.668219 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 686/1379] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:08.829785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c13a-04c9-44ce-813e-b3c97dead45f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:08.844104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c13a-04c9-44ce-813e-b3c97dead45f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:08.849655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40848766-8fe5-4d93-a7e7-dc9b0ffd1b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:08.850298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40848766-8fe5-4d93-a7e7-dc9b0ffd1b20 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:08.850604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40848766-8fe5-4d93-a7e7-dc9b0ffd1b20 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:08.851434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40848766-8fe5-4d93-a7e7-dc9b0ffd1b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:08.859683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40848766-8fe5-4d93-a7e7-dc9b0ffd1b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:08.861275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40848766-8fe5-4d93-a7e7-dc9b0ffd1b20 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:08.871480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 694/1380] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:10.245246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235af86-aaa5-40fa-a466-c961505ed899 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:10.245817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235af86-aaa5-40fa-a466-c961505ed899 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:10.245817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235af86-aaa5-40fa-a466-c961505ed899 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:10.247607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 687/1381] 10.222.0.73 () {54 vars in 911 bytes} [Fri Aug 27 03:57:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:57:10.253130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceaf28-6bb6-4983-96c5-65a05f9f3c99 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:10.253517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceaf28-6bb6-4983-96c5-65a05f9f3c99 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:10.253715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceaf28-6bb6-4983-96c5-65a05f9f3c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:10.271654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2dceaf28-6bb6-4983-96c5-65a05f9f3c99 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:10.272895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2dceaf28-6bb6-4983-96c5-65a05f9f3c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:10.281418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 695/1382] 10.222.0.73 () {58 vars in 1009 bytes} [Fri Aug 27 03:57:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:10.437301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235af86-aaa5-40fa-a466-c961505ed899 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:10.453231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235af86-aaa5-40fa-a466-c961505ed899 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:10.458661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9f86d-d5b2-4c7f-ad3a-ef73680f8df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:10.459298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f86d-d5b2-4c7f-ad3a-ef73680f8df7 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:10.459588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f86d-d5b2-4c7f-ad3a-ef73680f8df7 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:10.459869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f86d-d5b2-4c7f-ad3a-ef73680f8df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:10.468756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9f86d-d5b2-4c7f-ad3a-ef73680f8df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:10.470321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9f86d-d5b2-4c7f-ad3a-ef73680f8df7 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:10.480157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 688/1383] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:12.549254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972738b-51da-43ba-979c-83df26baf1b6 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:12.549820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972738b-51da-43ba-979c-83df26baf1b6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:12.549820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972738b-51da-43ba-979c-83df26baf1b6 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:12.551630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 696/1384] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:12.557675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1be295-6065-4187-adb5-9e9a1d17c1ab None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:12.558363 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1be295-6065-4187-adb5-9e9a1d17c1ab None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:12.558629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1be295-6065-4187-adb5-9e9a1d17c1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:12.576927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9b1be295-6065-4187-adb5-9e9a1d17c1ab None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:12.578176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9b1be295-6065-4187-adb5-9e9a1d17c1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:12.586694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 689/1385] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:12.624697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972738b-51da-43ba-979c-83df26baf1b6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:12.635758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972738b-51da-43ba-979c-83df26baf1b6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:12.639276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975acb0-135f-46dd-a2ee-1f958c848073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:12.639905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975acb0-135f-46dd-a2ee-1f958c848073 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:12.640188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975acb0-135f-46dd-a2ee-1f958c848073 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:12.640466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975acb0-135f-46dd-a2ee-1f958c848073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:12.650111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975acb0-135f-46dd-a2ee-1f958c848073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:12.651593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975acb0-135f-46dd-a2ee-1f958c848073 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:12.661520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 697/1386] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:14.958176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed79f8-12be-4204-aff2-3abdaad7f310 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:14.958747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed79f8-12be-4204-aff2-3abdaad7f310 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:14.958839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed79f8-12be-4204-aff2-3abdaad7f310 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:14.960560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 690/1387] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:14.966980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19fa0c-2007-47f8-91d8-8f19ccbc7a7b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:14.967392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19fa0c-2007-47f8-91d8-8f19ccbc7a7b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:14.967533 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19fa0c-2007-47f8-91d8-8f19ccbc7a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:14.985153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7d19fa0c-2007-47f8-91d8-8f19ccbc7a7b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:14.986346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7d19fa0c-2007-47f8-91d8-8f19ccbc7a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:14.994218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 698/1388] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:15.033153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed79f8-12be-4204-aff2-3abdaad7f310 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:15.043896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed79f8-12be-4204-aff2-3abdaad7f310 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:15.047698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef7298-fb26-463c-841e-f09c577d97e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:15.048329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7298-fb26-463c-841e-f09c577d97e0 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:15.048611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7298-fb26-463c-841e-f09c577d97e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:15.048887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7298-fb26-463c-841e-f09c577d97e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:15.058153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef7298-fb26-463c-841e-f09c577d97e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:15.059614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef7298-fb26-463c-841e-f09c577d97e0 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:15.068808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 691/1389] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:17.552930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fafb-deec-42cb-b119-cad012c50dfe None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:17.553467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fafb-deec-42cb-b119-cad012c50dfe None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:17.553467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fafb-deec-42cb-b119-cad012c50dfe None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:17.556355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 699/1390] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:17.562240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4975a7-be9c-433d-8943-c225c16f7583 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:17.562666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4975a7-be9c-433d-8943-c225c16f7583 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:17.562941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4975a7-be9c-433d-8943-c225c16f7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:17.581945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-fe4975a7-be9c-433d-8943-c225c16f7583 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:17.582845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fe4975a7-be9c-433d-8943-c225c16f7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:17.591583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 692/1391] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:17.630538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fafb-deec-42cb-b119-cad012c50dfe None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:17.642043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fafb-deec-42cb-b119-cad012c50dfe None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:17.645606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37e540-ba17-4cb2-b421-d725a280b3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:17.646248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e540-ba17-4cb2-b421-d725a280b3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:17.646535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e540-ba17-4cb2-b421-d725a280b3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:17.646846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e540-ba17-4cb2-b421-d725a280b3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:17.656691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37e540-ba17-4cb2-b421-d725a280b3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:17.658122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37e540-ba17-4cb2-b421-d725a280b3e8 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:17.668437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 700/1392] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:19.951297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e14db1-f8fa-4d3a-b9b6-0bcd94fe531e None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:19.951832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e14db1-f8fa-4d3a-b9b6-0bcd94fe531e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:19.951832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e14db1-f8fa-4d3a-b9b6-0bcd94fe531e None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:19.953650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 693/1393] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:19.959424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28fc79-ffef-4d98-931f-a38fb2bfa0d5 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:19.959850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28fc79-ffef-4d98-931f-a38fb2bfa0d5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:19.959986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28fc79-ffef-4d98-931f-a38fb2bfa0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:19.977974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bc28fc79-ffef-4d98-931f-a38fb2bfa0d5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:19.979196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bc28fc79-ffef-4d98-931f-a38fb2bfa0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:19.987152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 701/1394] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:20.027483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e14db1-f8fa-4d3a-b9b6-0bcd94fe531e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:20.029198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-30e14db1-f8fa-4d3a-b9b6-0bcd94fe531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:20.043155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e14db1-f8fa-4d3a-b9b6-0bcd94fe531e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:20.046956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74b62-90f3-4709-acb2-2eefdf810923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:20.047597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74b62-90f3-4709-acb2-2eefdf810923 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:20.047879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74b62-90f3-4709-acb2-2eefdf810923 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:20.048156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74b62-90f3-4709-acb2-2eefdf810923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:20.057944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e74b62-90f3-4709-acb2-2eefdf810923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:20.059407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e74b62-90f3-4709-acb2-2eefdf810923 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:20.068614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 694/1395] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:22.369749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5420fd7-c274-466d-860b-37a7f0a57e25 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:22.370289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5420fd7-c274-466d-860b-37a7f0a57e25 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:22.370289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5420fd7-c274-466d-860b-37a7f0a57e25 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:22.372138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 702/1396] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:22.378125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684008-9c1e-4f89-a1b5-582cf4761c11 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:22.378510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684008-9c1e-4f89-a1b5-582cf4761c11 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:22.378736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684008-9c1e-4f89-a1b5-582cf4761c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:22.397049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-87684008-9c1e-4f89-a1b5-582cf4761c11 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:22.399114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-87684008-9c1e-4f89-a1b5-582cf4761c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:22.406842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 695/1397] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:22.447224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5420fd7-c274-466d-860b-37a7f0a57e25 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:22.458926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5420fd7-c274-466d-860b-37a7f0a57e25 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:22.463720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975c68c-b42c-446d-9e64-7f1e5858aaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:22.464500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975c68c-b42c-446d-9e64-7f1e5858aaff service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:22.464802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975c68c-b42c-446d-9e64-7f1e5858aaff service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:22.465079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975c68c-b42c-446d-9e64-7f1e5858aaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:22.474288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975c68c-b42c-446d-9e64-7f1e5858aaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:22.475764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975c68c-b42c-446d-9e64-7f1e5858aaff service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:22.484959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 703/1398] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:24.760391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab0bb3-c340-4763-812f-0f1f1449a272 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:24.760961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab0bb3-c340-4763-812f-0f1f1449a272 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:24.760961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab0bb3-c340-4763-812f-0f1f1449a272 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:24.762728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 696/1399] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:24.768677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef137e3-5f1b-414e-815d-70e052438ad5 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:24.769080 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef137e3-5f1b-414e-815d-70e052438ad5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:24.769227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef137e3-5f1b-414e-815d-70e052438ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:24.787238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bef137e3-5f1b-414e-815d-70e052438ad5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:24.788550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bef137e3-5f1b-414e-815d-70e052438ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:24.796544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 704/1400] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:24.835832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab0bb3-c340-4763-812f-0f1f1449a272 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:24.846348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab0bb3-c340-4763-812f-0f1f1449a272 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:24.849899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334deae4-d59b-4d94-8a9b-d21e0a027f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:24.850551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334deae4-d59b-4d94-8a9b-d21e0a027f46 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:24.850863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334deae4-d59b-4d94-8a9b-d21e0a027f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:24.851161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334deae4-d59b-4d94-8a9b-d21e0a027f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:24.859832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334deae4-d59b-4d94-8a9b-d21e0a027f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:24.861251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334deae4-d59b-4d94-8a9b-d21e0a027f46 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:24.871074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 697/1401] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:27.089194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb741b-ed9e-4f8a-b8db-89313ed67c22 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:27.263441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb741b-ed9e-4f8a-b8db-89313ed67c22 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:27.263441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb741b-ed9e-4f8a-b8db-89313ed67c22 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:27.263441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 705/1402] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:27.264358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16364-4f67-4d54-8034-fb21abedb6ed None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:27.264358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16364-4f67-4d54-8034-fb21abedb6ed None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:27.264358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16364-4f67-4d54-8034-fb21abedb6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:27.264358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-90a16364-4f67-4d54-8034-fb21abedb6ed None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:27.264358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-90a16364-4f67-4d54-8034-fb21abedb6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:27.264358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 698/1403] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:27.265098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb741b-ed9e-4f8a-b8db-89313ed67c22 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:27.265098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb741b-ed9e-4f8a-b8db-89313ed67c22 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:27.265098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca1b44-cbd6-43a2-9591-6aa15d471b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:27.265098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1b44-cbd6-43a2-9591-6aa15d471b93 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:27.265414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1b44-cbd6-43a2-9591-6aa15d471b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:27.265414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1b44-cbd6-43a2-9591-6aa15d471b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:27.265414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca1b44-cbd6-43a2-9591-6aa15d471b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:27.265414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca1b44-cbd6-43a2-9591-6aa15d471b93 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:27.265414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 706/1404] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:29.368172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811317a5-ce09-40ac-861b-918d4d7e85dd None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:29.368743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811317a5-ce09-40ac-861b-918d4d7e85dd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:29.368743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811317a5-ce09-40ac-861b-918d4d7e85dd None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:29.370417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 699/1405] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:29.376213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff142-93b6-48a6-b7e2-1887186a1220 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:29.376667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff142-93b6-48a6-b7e2-1887186a1220 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:29.376803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff142-93b6-48a6-b7e2-1887186a1220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:29.394071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1a7ff142-93b6-48a6-b7e2-1887186a1220 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:29.395306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1a7ff142-93b6-48a6-b7e2-1887186a1220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:29.403599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 707/1406] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:29.441442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811317a5-ce09-40ac-861b-918d4d7e85dd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:29.451896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811317a5-ce09-40ac-861b-918d4d7e85dd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:29.455589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bd0a5-58e0-4863-b22d-89766caf70d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:29.456220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bd0a5-58e0-4863-b22d-89766caf70d4 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:29.456503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bd0a5-58e0-4863-b22d-89766caf70d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:29.456779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bd0a5-58e0-4863-b22d-89766caf70d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:29.465995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bd0a5-58e0-4863-b22d-89766caf70d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:29.467440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bd0a5-58e0-4863-b22d-89766caf70d4 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:29.477142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 700/1407] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:31.660022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802828-1d0d-4aa1-8f13-955c7b76febf None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:31.660569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802828-1d0d-4aa1-8f13-955c7b76febf None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:31.660569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802828-1d0d-4aa1-8f13-955c7b76febf None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:31.662356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 708/1408] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:31.668656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb250d5-19e7-4f83-beee-ba3c72b2ce2c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:31.669104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb250d5-19e7-4f83-beee-ba3c72b2ce2c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:31.669216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb250d5-19e7-4f83-beee-ba3c72b2ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:31.688179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-cfb250d5-19e7-4f83-beee-ba3c72b2ce2c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:31.689398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cfb250d5-19e7-4f83-beee-ba3c72b2ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:31.697688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 701/1409] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:31.734447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802828-1d0d-4aa1-8f13-955c7b76febf None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:31.745479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802828-1d0d-4aa1-8f13-955c7b76febf None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:31.749048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3abaa-1602-40cd-8754-561d7f65ff48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:31.749705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3abaa-1602-40cd-8754-561d7f65ff48 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:31.749988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3abaa-1602-40cd-8754-561d7f65ff48 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:31.750264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3abaa-1602-40cd-8754-561d7f65ff48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:31.759523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3abaa-1602-40cd-8754-561d7f65ff48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:31.760954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3abaa-1602-40cd-8754-561d7f65ff48 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:31.770109 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 709/1410] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:33.960725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298308c3-33ac-438b-93a0-60324fe5da0c None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:33.961299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298308c3-33ac-438b-93a0-60324fe5da0c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:33.961299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298308c3-33ac-438b-93a0-60324fe5da0c None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:33.963140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 702/1411] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:57:33.969032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd459dd-7fee-400c-9cbb-03058552be68 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:33.969492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd459dd-7fee-400c-9cbb-03058552be68 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:33.969599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd459dd-7fee-400c-9cbb-03058552be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:33.987249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9cd459dd-7fee-400c-9cbb-03058552be68 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:33.988446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9cd459dd-7fee-400c-9cbb-03058552be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:33.996975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 710/1412] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:34.035403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298308c3-33ac-438b-93a0-60324fe5da0c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:34.046079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298308c3-33ac-438b-93a0-60324fe5da0c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:34.049606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc616-e0ce-4872-aa65-d56dd0663bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:34.050232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc616-e0ce-4872-aa65-d56dd0663bdc service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:34.050513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc616-e0ce-4872-aa65-d56dd0663bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:34.050814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc616-e0ce-4872-aa65-d56dd0663bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:34.059964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc616-e0ce-4872-aa65-d56dd0663bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:34.061370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc616-e0ce-4872-aa65-d56dd0663bdc service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:34.071167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 703/1413] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:51.008721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f16ed-197b-4ec8-b5e4-5ca9bc7e3940 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:51.009227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f16ed-197b-4ec8-b5e4-5ca9bc7e3940 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:51.009323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f16ed-197b-4ec8-b5e4-5ca9bc7e3940 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:51.011074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 711/1414] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:51.016989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6156d-4f16-4d9d-80f8-34a2caaa80ab None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:51.017406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6156d-4f16-4d9d-80f8-34a2caaa80ab None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:51.017550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6156d-4f16-4d9d-80f8-34a2caaa80ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:51.035894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a0f6156d-4f16-4d9d-80f8-34a2caaa80ab None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:51.037781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a0f6156d-4f16-4d9d-80f8-34a2caaa80ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:51.045604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 704/1415] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:51.096412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756117-433d-4e1a-89f3-3f6867041a13 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:51.096703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756117-433d-4e1a-89f3-3f6867041a13 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:51.096980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756117-433d-4e1a-89f3-3f6867041a13 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:51.098821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 712/1416] 10.222.0.73 () {54 vars in 966 bytes} [Fri Aug 27 03:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:51.104962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433262-b1ea-47a7-b14b-c798f7e2db4f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:51.105331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433262-b1ea-47a7-b14b-c798f7e2db4f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:51.105619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433262-b1ea-47a7-b14b-c798f7e2db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:51.123915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ce433262-b1ea-47a7-b14b-c798f7e2db4f None None] MFA Rules not processed for user `4f148f069b014ed5baa06b408bab5d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:51.125120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ce433262-b1ea-47a7-b14b-c798f7e2db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:51.131828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 705/1417] 10.222.0.73 () {58 vars in 1064 bytes} [Fri Aug 27 03:57:51 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:51.139695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756117-433d-4e1a-89f3-3f6867041a13 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:51.150839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756117-433d-4e1a-89f3-3f6867041a13 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:51.154464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dbd54-8ca6-4c33-893a-f31e25a9cc8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:51.155140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dbd54-8ca6-4c33-893a-f31e25a9cc8c service glance] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:51.155423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dbd54-8ca6-4c33-893a-f31e25a9cc8c service glance] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:51.155750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dbd54-8ca6-4c33-893a-f31e25a9cc8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:51.165622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dbd54-8ca6-4c33-893a-f31e25a9cc8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:51.167104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dbd54-8ca6-4c33-893a-f31e25a9cc8c service glance] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:51.177076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 713/1418] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:57:53.422983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020a4b-2fa1-4807-8f33-78b7a1e4efad None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:53.423809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020a4b-2fa1-4807-8f33-78b7a1e4efad None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:53.424007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020a4b-2fa1-4807-8f33-78b7a1e4efad None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:53.425986 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 706/1419] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:53.432522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2ee26-bb33-4665-8965-5a68c66ba8ec None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:53.432964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2ee26-bb33-4665-8965-5a68c66ba8ec None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:53.433071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2ee26-bb33-4665-8965-5a68c66ba8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:53.452157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-72c2ee26-bb33-4665-8965-5a68c66ba8ec None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:53.453357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-72c2ee26-bb33-4665-8965-5a68c66ba8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:53.461131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 714/1420] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:53.485107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0020a4b-2fa1-4807-8f33-78b7a1e4efad None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:53.498261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0020a4b-2fa1-4807-8f33-78b7a1e4efad None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:53.502718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74476f-b0da-45eb-b40d-f749d5dcb931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:53.503366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74476f-b0da-45eb-b40d-f749d5dcb931 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:53.503649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74476f-b0da-45eb-b40d-f749d5dcb931 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:53.503925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74476f-b0da-45eb-b40d-f749d5dcb931 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:53.504648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74476f-b0da-45eb-b40d-f749d5dcb931 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:53.507258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74476f-b0da-45eb-b40d-f749d5dcb931 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:53.520827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 707/1421] 10.222.0.73 () {56 vars in 1109 bytes} [Fri Aug 27 03:57:53 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:57:55.756042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc69a0-ed9d-4946-871e-bec67df01d3e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:55.756608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc69a0-ed9d-4946-871e-bec67df01d3e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:55.756608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc69a0-ed9d-4946-871e-bec67df01d3e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:55.758332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 715/1422] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:55.764437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd67d-2787-4f1d-af48-b8c21f5b6592 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:55.764902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd67d-2787-4f1d-af48-b8c21f5b6592 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:55.765020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd67d-2787-4f1d-af48-b8c21f5b6592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:55.785330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0f5cd67d-2787-4f1d-af48-b8c21f5b6592 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:55.787249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0f5cd67d-2787-4f1d-af48-b8c21f5b6592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:55.795106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 708/1423] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:55.844384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc69a0-ed9d-4946-871e-bec67df01d3e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:55.866801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc69a0-ed9d-4946-871e-bec67df01d3e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:55.873651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c803b-73e9-4119-b7ab-d1796fc8083b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:55.875054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c803b-73e9-4119-b7ab-d1796fc8083b service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:55.875941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c803b-73e9-4119-b7ab-d1796fc8083b service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:55.876228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c803b-73e9-4119-b7ab-d1796fc8083b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:55.885495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c803b-73e9-4119-b7ab-d1796fc8083b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:55.887153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c803b-73e9-4119-b7ab-d1796fc8083b service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:55.903399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 716/1424] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:58.375583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12effeb-4812-4771-a675-76b65213e4fd None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:58.376307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12effeb-4812-4771-a675-76b65213e4fd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:58.376307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12effeb-4812-4771-a675-76b65213e4fd None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:58.377977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 709/1425] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:57:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:57:58.384239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee5f0-c293-4a72-a45c-20987de422d4 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:58.384712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee5f0-c293-4a72-a45c-20987de422d4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:58.384818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee5f0-c293-4a72-a45c-20987de422d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:58.403525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-aaaee5f0-c293-4a72-a45c-20987de422d4 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:57:58.404736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-aaaee5f0-c293-4a72-a45c-20987de422d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:57:58.413872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 717/1426] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:57:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:57:58.455231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12effeb-4812-4771-a675-76b65213e4fd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:57:58.466276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12effeb-4812-4771-a675-76b65213e4fd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:57:58.469835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d41375-80fb-4304-a251-8cf883cfd68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:57:58.470481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d41375-80fb-4304-a251-8cf883cfd68e service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:57:58.470803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d41375-80fb-4304-a251-8cf883cfd68e service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:57:58.471083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d41375-80fb-4304-a251-8cf883cfd68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:57:58.481078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d41375-80fb-4304-a251-8cf883cfd68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:57:58.482508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d41375-80fb-4304-a251-8cf883cfd68e service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:57:58.492411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 710/1427] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:57:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:58:00.836124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872abd0-9b96-4131-a1c9-d7af8e80b70e None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:00.836723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872abd0-9b96-4131-a1c9-d7af8e80b70e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:00.836723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872abd0-9b96-4131-a1c9-d7af8e80b70e None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:00.838491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 718/1428] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:58:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:58:00.845174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec581f-3707-4ca1-ac46-3a982bd0f5dd None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:00.845791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec581f-3707-4ca1-ac46-3a982bd0f5dd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:00.845791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec581f-3707-4ca1-ac46-3a982bd0f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:00.865926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f5ec581f-3707-4ca1-ac46-3a982bd0f5dd None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:58:00.867253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f5ec581f-3707-4ca1-ac46-3a982bd0f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:58:00.875537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 711/1429] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:58:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:58:00.920575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872abd0-9b96-4131-a1c9-d7af8e80b70e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:58:00.937688 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872abd0-9b96-4131-a1c9-d7af8e80b70e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:58:00.941594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aedd1f-15f0-46a8-b3bb-506bded57304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:58:00.942293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedd1f-15f0-46a8-b3bb-506bded57304 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:00.943434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedd1f-15f0-46a8-b3bb-506bded57304 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:00.943434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedd1f-15f0-46a8-b3bb-506bded57304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:00.953579 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aedd1f-15f0-46a8-b3bb-506bded57304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:58:00.955068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aedd1f-15f0-46a8-b3bb-506bded57304 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:58:00.965733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 719/1430] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:58:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:58:03.623458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec34ff-2f2f-42da-a422-24c802e6bffd None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:03.624051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec34ff-2f2f-42da-a422-24c802e6bffd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:03.624171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec34ff-2f2f-42da-a422-24c802e6bffd None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:03.626843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 712/1431] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:58:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:58:03.634808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618532-8709-42e6-ba57-e6d27919818f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:03.635366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618532-8709-42e6-ba57-e6d27919818f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:03.635366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618532-8709-42e6-ba57-e6d27919818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:03.654932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-55618532-8709-42e6-ba57-e6d27919818f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:58:03.656480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-55618532-8709-42e6-ba57-e6d27919818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:58:03.666133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 720/1432] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:58:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:58:03.712579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec34ff-2f2f-42da-a422-24c802e6bffd None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:58:03.723575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec34ff-2f2f-42da-a422-24c802e6bffd None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:58:03.727201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195e4ae-d57c-4362-b4b1-e30edb604045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:58:03.727847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195e4ae-d57c-4362-b4b1-e30edb604045 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:03.728126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195e4ae-d57c-4362-b4b1-e30edb604045 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:03.728398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195e4ae-d57c-4362-b4b1-e30edb604045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:03.737746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195e4ae-d57c-4362-b4b1-e30edb604045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:58:03.739249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195e4ae-d57c-4362-b4b1-e30edb604045 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:58:03.749682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 713/1433] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:58:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:58:06.648591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa29e3-fb1c-41f5-99b3-0d55b8cdc137 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:06.649205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa29e3-fb1c-41f5-99b3-0d55b8cdc137 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:06.649205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa29e3-fb1c-41f5-99b3-0d55b8cdc137 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:06.650966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 721/1434] 10.222.0.73 () {54 vars in 926 bytes} [Fri Aug 27 03:58:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:58:06.658353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5c08c-1ffb-48c3-87e4-d6d5c3b66582 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:06.658893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5c08c-1ffb-48c3-87e4-d6d5c3b66582 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:06.658985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5c08c-1ffb-48c3-87e4-d6d5c3b66582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:06.679602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a1d5c08c-1ffb-48c3-87e4-d6d5c3b66582 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:58:06.680820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a1d5c08c-1ffb-48c3-87e4-d6d5c3b66582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:58:06.688650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 714/1435] 10.222.0.73 () {58 vars in 1024 bytes} [Fri Aug 27 03:58:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:58:06.729845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa29e3-fb1c-41f5-99b3-0d55b8cdc137 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:58:06.741811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa29e3-fb1c-41f5-99b3-0d55b8cdc137 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:58:06.745436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91dc94-7e63-4734-a0e1-32450ead4ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:58:06.746131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91dc94-7e63-4734-a0e1-32450ead4ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:58:06.746479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91dc94-7e63-4734-a0e1-32450ead4ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:58:06.746796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91dc94-7e63-4734-a0e1-32450ead4ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:58:06.758339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91dc94-7e63-4734-a0e1-32450ead4ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:58:06.760916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91dc94-7e63-4734-a0e1-32450ead4ee9 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:58:06.773084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 722/1436] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:58:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:59:38.605947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:38.607715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:38.607715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:38.637417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:59:38.639442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:59:38.648092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 715/1437] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 03:59:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:59:38.657502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:38.658008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:38.658221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:38.681492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:59:38.683116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:59:38.692260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 723/1438] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 03:59:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:59:38.697946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:38.714879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef547d-f765-4dd4-a569-4b602a0cc414 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:38.723713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:38.724809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:38.725226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:38.725706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:38.726925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:59:38.727458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:38.730416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:38.750668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 716/1439] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 03:59:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:59:38.763010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:38.773618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd250c7-e1b3-4a4d-8b65-a7d2e2a2b69e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:38.778443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:38.779143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:38.779423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:38.779691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:38.780384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:38.783004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:38.930045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 724/1440] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 03:59:38 2021] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:59:38.936450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:38.949787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1078-46ed-4660-8d5d-13036595f7f1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:39.032476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:39.033194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.033516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.033835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.034721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:39.036699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:39.225274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 717/1441] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 03:59:38 2021] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:59:39.231222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:39.256788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26e766-2246-465c-a376-8242abfd5369 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:39.263503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:39.264196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.264482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.264761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.265509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:39.267555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:39.282391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 725/1442] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 03:59:39 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:59:39.289283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:39.304446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea8b0-3a09-42eb-a575-1e5014389771 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:39.309867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa7b40-7cb6-4441-b58b-e0df68d8ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:39.310583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa7b40-7cb6-4441-b58b-e0df68d8ef80 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.310867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa7b40-7cb6-4441-b58b-e0df68d8ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.311145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa7b40-7cb6-4441-b58b-e0df68d8ef80 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.311890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa7b40-7cb6-4441-b58b-e0df68d8ef80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:39.314257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa7b40-7cb6-4441-b58b-e0df68d8ef80 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:39.335217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 718/1443] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 03:59:39 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:59:39.340588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:39.357580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5bb2-3365-4b61-bda0-acec42498f31 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:39.366714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:39.368250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.368728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.369721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] PATH_INFO: `/v3/projects/8a3f8a356b044448aaa85a521a67940d/users/4192198ff0e4449faae8c7bfd5eea5d5/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.398498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3f8a356b044448aaa85a521a67940d, user_id=4192198ff0e4449faae8c7bfd5eea5d5, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:39.401997 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:39.506640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 726/1444] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 03:59:39 2021] PUT /identity/v3/projects/8a3f8a356b044448aaa85a521a67940d/users/4192198ff0e4449faae8c7bfd5eea5d5/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:59:39.525413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae920-77c2-4400-a970-000bad4c3696 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.525904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae920-77c2-4400-a970-000bad4c3696 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.526351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae920-77c2-4400-a970-000bad4c3696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.573029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-748ae920-77c2-4400-a970-000bad4c3696 None None] MFA Rules not processed for user `4192198ff0e4449faae8c7bfd5eea5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:59:39.575000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-748ae920-77c2-4400-a970-000bad4c3696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:59:39.671585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 719/1445] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 03:59:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:59:39.685315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:39.761356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a67cb-66d7-4a05-8742-4b8b4b0c8c4b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:39.767769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:39.768437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.768722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.769004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.778496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:39.780454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:39.791697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 727/1446] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:59:39 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:59:39.886264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de872-aa1b-44fe-bb24-cc2c248b9052 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.886707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de872-aa1b-44fe-bb24-cc2c248b9052 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.887262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de872-aa1b-44fe-bb24-cc2c248b9052 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.892675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 720/1447] 10.222.0.73 () {52 vars in 829 bytes} [Fri Aug 27 03:59:39 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:59:39.895648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:39.975706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c0efc-b323-4de7-9957-b4011e13a1e3 service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:39.982413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:39.983415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:39.984090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:39.985005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] PATH_INFO: `/v3/users/4192198ff0e4449faae8c7bfd5eea5d5` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:39.986874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4192198ff0e4449faae8c7bfd5eea5d5)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:39.987924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:59:39.987924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 03:59:39.987924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 03:59:39.989169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:40.382761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4192198ff0e4449faae8c7bfd5eea5d5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:40.383956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4192198ff0e4449faae8c7bfd5eea5d5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:40.467410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4192198ff0e4449faae8c7bfd5eea5d5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:40.468139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4192198ff0e4449faae8c7bfd5eea5d5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:40.495778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4192198ff0e4449faae8c7bfd5eea5d5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:40.517819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 728/1448] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 03:59:39 2021] DELETE /identity/v3/users/4192198ff0e4449faae8c7bfd5eea5d5 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:59:40.522724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:40.523056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:40.523374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:40.544167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:59:40.545847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:59:40.612922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 721/1449] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 03:59:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:59:40.627642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:40.629482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:59:40.702134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79f535-0688-4a37-9dc4-581d80441119 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:40.708001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3b1a8-40ec-40d2-82bc-0b77aa6ff605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:40.708828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b1a8-40ec-40d2-82bc-0b77aa6ff605 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:40.709216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b1a8-40ec-40d2-82bc-0b77aa6ff605 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:40.709590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b1a8-40ec-40d2-82bc-0b77aa6ff605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:40.721064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3b1a8-40ec-40d2-82bc-0b77aa6ff605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:40.722870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3b1a8-40ec-40d2-82bc-0b77aa6ff605 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:40.734446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 729/1450] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 03:59:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:59:41.674274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:59:41.676449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:59:41.708072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e4a28-53c6-411f-925f-79454d7815e5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:59:41.717082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:59:41.719410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:59:41.719873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:59:41.720235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] PATH_INFO: `/v3/projects/8a3f8a356b044448aaa85a521a67940d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:59:41.722687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3f8a356b044448aaa85a521a67940d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:59:41.724977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:59:41.724977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 03:59:41.724977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 03:59:41.727319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:59:41.909763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3f8a356b044448aaa85a521a67940d', 'request_id': 'req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:41.925206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3f8a356b044448aaa85a521a67940d', 'request_id': 'req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:42.057708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3f8a356b044448aaa85a521a67940d', 'request_id': 'req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:42.072814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] The token cache is being invalidate because project 8a3f8a356b044448aaa85a521a67940d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:59:42.073156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:42.074016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-95ff7fcb-4274-4ebd-837c-fce60a8e9aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:59:42.076260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 722/1451] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 03:59:41 2021] DELETE /identity/v3/projects/8a3f8a356b044448aaa85a521a67940d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:01:16.651005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc78cb-263a-466e-8a63-a5cf64afb897 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:16.652475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc78cb-263a-466e-8a63-a5cf64afb897 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:16.652475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc78cb-263a-466e-8a63-a5cf64afb897 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:16.654128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 730/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:01:16.660155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc486-055c-4ee1-93fc-1a375300a088 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:16.660878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc486-055c-4ee1-93fc-1a375300a088 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:16.660878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc486-055c-4ee1-93fc-1a375300a088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:16.682410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-bc2cc486-055c-4ee1-93fc-1a375300a088 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:16.683996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-bc2cc486-055c-4ee1-93fc-1a375300a088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:16.758083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 723/1453] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:01:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:01:16.927741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc78cb-263a-466e-8a63-a5cf64afb897 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:16.930457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-50cc78cb-263a-466e-8a63-a5cf64afb897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:16.952958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b1c7b-f40f-4164-a4d3-e611100f5474 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:16.953436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b1c7b-f40f-4164-a4d3-e611100f5474 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:16.953902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b1c7b-f40f-4164-a4d3-e611100f5474 None None] PATH_INFO: `/v3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:16.956356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 724/1454] 10.222.0.74 () {54 vars in 926 bytes} [Fri Aug 27 04:01:16 2021] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:01:16.967483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d880-4f4c-4b1e-a276-a7c7a03c7bb6 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:16.967931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d880-4f4c-4b1e-a276-a7c7a03c7bb6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:16.968400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d880-4f4c-4b1e-a276-a7c7a03c7bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:17.000068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8881d880-4f4c-4b1e-a276-a7c7a03c7bb6 None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:17.002027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8881d880-4f4c-4b1e-a276-a7c7a03c7bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:17.051043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc78cb-263a-466e-8a63-a5cf64afb897 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:17.060386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64b70-924a-4302-9bf1-d2cb3b091db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:17.061414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64b70-924a-4302-9bf1-d2cb3b091db6 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:17.062022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64b70-924a-4302-9bf1-d2cb3b091db6 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:17.062473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64b70-924a-4302-9bf1-d2cb3b091db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:17.076475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64b70-924a-4302-9bf1-d2cb3b091db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:17.079506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64b70-924a-4302-9bf1-d2cb3b091db6 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:17.094003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 731/1455] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:01:17.121046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 725/1456] 10.222.0.74 () {58 vars in 1016 bytes} [Fri Aug 27 04:01:16 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:01:18.590261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411310a-266c-4774-86e1-33b7f2c48741 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:18.590925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411310a-266c-4774-86e1-33b7f2c48741 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:18.591084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411310a-266c-4774-86e1-33b7f2c48741 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:18.593654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 732/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:01:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:01:18.600614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f345-e88a-4a15-89ab-5b02001d9250 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:18.600614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f345-e88a-4a15-89ab-5b02001d9250 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:18.600614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f345-e88a-4a15-89ab-5b02001d9250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:18.620642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6618f345-e88a-4a15-89ab-5b02001d9250 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:18.623681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6618f345-e88a-4a15-89ab-5b02001d9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:18.632902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 726/1458] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:01:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:01:18.802384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411310a-266c-4774-86e1-33b7f2c48741 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:18.819034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411310a-266c-4774-86e1-33b7f2c48741 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:18.831473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1827fb-9c8e-45ab-9c29-2496dbb6e113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:18.833719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1827fb-9c8e-45ab-9c29-2496dbb6e113 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:18.834211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1827fb-9c8e-45ab-9c29-2496dbb6e113 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:18.834514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1827fb-9c8e-45ab-9c29-2496dbb6e113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:18.848575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1827fb-9c8e-45ab-9c29-2496dbb6e113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:18.850078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1827fb-9c8e-45ab-9c29-2496dbb6e113 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:18.861374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 733/1459] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:26.321845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2398-1948-49de-8439-cd8b6a445cd2 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:26.322292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2398-1948-49de-8439-cd8b6a445cd2 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:26.323600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2398-1948-49de-8439-cd8b6a445cd2 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:26.324365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 727/1460] 10.222.0.73 () {54 vars in 960 bytes} [Fri Aug 27 04:01:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:01:26.330233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605aef3-866f-49af-8b78-f8fc85d0f9c6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:26.330721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605aef3-866f-49af-8b78-f8fc85d0f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:26.330924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605aef3-866f-49af-8b78-f8fc85d0f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:26.349642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b605aef3-866f-49af-8b78-f8fc85d0f9c6 None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:26.350919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b605aef3-866f-49af-8b78-f8fc85d0f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:26.363290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 734/1461] 10.222.0.73 () {58 vars in 1058 bytes} [Fri Aug 27 04:01:26 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:26.371832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf2398-1948-49de-8439-cd8b6a445cd2 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:26.385001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf2398-1948-49de-8439-cd8b6a445cd2 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:26.390626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abfa8c-bd2d-4b3b-9603-28f954cd01e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:26.414447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfa8c-bd2d-4b3b-9603-28f954cd01e0 service placement] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:26.414447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfa8c-bd2d-4b3b-9603-28f954cd01e0 service placement] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:26.414447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfa8c-bd2d-4b3b-9603-28f954cd01e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:26.414447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abfa8c-bd2d-4b3b-9603-28f954cd01e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:26.414447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abfa8c-bd2d-4b3b-9603-28f954cd01e0 service placement] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:26.414447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 728/1462] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:30.701427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740c12-f765-40dd-b905-7a9c2c94d211 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:30.702016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740c12-f765-40dd-b905-7a9c2c94d211 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:30.702016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740c12-f765-40dd-b905-7a9c2c94d211 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:30.703791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 735/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:01:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:01:30.708986 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cf09-677e-4bf1-8171-03266afcd5c0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:30.709386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cf09-677e-4bf1-8171-03266afcd5c0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:30.709535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67cf09-677e-4bf1-8171-03266afcd5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:30.727250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ee67cf09-677e-4bf1-8171-03266afcd5c0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:30.728449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ee67cf09-677e-4bf1-8171-03266afcd5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:30.737242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 729/1464] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:01:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:30.894477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740c12-f765-40dd-b905-7a9c2c94d211 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:30.908930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740c12-f765-40dd-b905-7a9c2c94d211 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:30.914295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba9446-16d6-4657-a9bc-2a926c29fb13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:30.914989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba9446-16d6-4657-a9bc-2a926c29fb13 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:30.915274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba9446-16d6-4657-a9bc-2a926c29fb13 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:30.915557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba9446-16d6-4657-a9bc-2a926c29fb13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:30.924492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba9446-16d6-4657-a9bc-2a926c29fb13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:30.926207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba9446-16d6-4657-a9bc-2a926c29fb13 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:30.936338 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 736/1465] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:32.327482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3a7c-f7fa-4e7c-b1c7-492113302997 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:32.328075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3a7c-f7fa-4e7c-b1c7-492113302997 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:32.328075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3a7c-f7fa-4e7c-b1c7-492113302997 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:32.330095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 730/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 04:01:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:01:32.336663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04012d7-8bec-4ada-a296-9ac1a4b5fd4a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:32.337251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04012d7-8bec-4ada-a296-9ac1a4b5fd4a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:32.337251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04012d7-8bec-4ada-a296-9ac1a4b5fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:32.356291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a04012d7-8bec-4ada-a296-9ac1a4b5fd4a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:32.357491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a04012d7-8bec-4ada-a296-9ac1a4b5fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:32.365627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 737/1467] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 04:01:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:32.534236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3a7c-f7fa-4e7c-b1c7-492113302997 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:32.551134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3a7c-f7fa-4e7c-b1c7-492113302997 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:32.556719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d3a7-d715-4db0-a084-5df5405f5d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:32.558059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d3a7-d715-4db0-a084-5df5405f5d6b service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:32.558344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d3a7-d715-4db0-a084-5df5405f5d6b service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:32.558657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d3a7-d715-4db0-a084-5df5405f5d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:32.569164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8d3a7-d715-4db0-a084-5df5405f5d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:32.570834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8d3a7-d715-4db0-a084-5df5405f5d6b service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:32.582710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 731/1468] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:36.979442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11280c10-532a-4e26-916d-cb0fbb8afba7 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:36.984133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11280c10-532a-4e26-916d-cb0fbb8afba7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:36.984133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11280c10-532a-4e26-916d-cb0fbb8afba7 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:36.984133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 738/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:01:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:01:36.988041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb78d0-ad52-4e51-9297-4fa4cc1d3e3f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:36.988530 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb78d0-ad52-4e51-9297-4fa4cc1d3e3f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:36.988628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb78d0-ad52-4e51-9297-4fa4cc1d3e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:37.008733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-59eb78d0-ad52-4e51-9297-4fa4cc1d3e3f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:37.009975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-59eb78d0-ad52-4e51-9297-4fa4cc1d3e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:37.019419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 732/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:01:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:37.059620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11280c10-532a-4e26-916d-cb0fbb8afba7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:37.061372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-11280c10-532a-4e26-916d-cb0fbb8afba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:37.120484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11280c10-532a-4e26-916d-cb0fbb8afba7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:37.124377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa41bd-62f5-448c-9422-182dd80dcb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:37.125033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa41bd-62f5-448c-9422-182dd80dcb17 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:37.125319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa41bd-62f5-448c-9422-182dd80dcb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:37.125598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa41bd-62f5-448c-9422-182dd80dcb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:37.134879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa41bd-62f5-448c-9422-182dd80dcb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:37.136626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa41bd-62f5-448c-9422-182dd80dcb17 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:37.146243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 739/1471] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:39.393551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa6295-1370-45c2-b51d-e06de9073e13 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:39.394215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa6295-1370-45c2-b51d-e06de9073e13 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:39.394215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa6295-1370-45c2-b51d-e06de9073e13 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:39.395916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 733/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:01:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:01:39.402494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6243-e1b8-4b8b-bcf6-488a7e74b8ab None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:39.403012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6243-e1b8-4b8b-bcf6-488a7e74b8ab None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:39.403116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6243-e1b8-4b8b-bcf6-488a7e74b8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:39.422762 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8e9a6243-e1b8-4b8b-bcf6-488a7e74b8ab None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:39.424077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8e9a6243-e1b8-4b8b-bcf6-488a7e74b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:39.432994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 740/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:01:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:39.473918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa6295-1370-45c2-b51d-e06de9073e13 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:39.475719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7bfa6295-1370-45c2-b51d-e06de9073e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:39.489382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa6295-1370-45c2-b51d-e06de9073e13 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:39.493175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fbc44-63f9-4cd3-aa9c-970bac7e93dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:39.493832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fbc44-63f9-4cd3-aa9c-970bac7e93dd service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:39.494792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fbc44-63f9-4cd3-aa9c-970bac7e93dd service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:39.495122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fbc44-63f9-4cd3-aa9c-970bac7e93dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:39.505070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fbc44-63f9-4cd3-aa9c-970bac7e93dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:39.506586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fbc44-63f9-4cd3-aa9c-970bac7e93dd service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:39.523130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 734/1474] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:43.674640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a394d36-f73f-4b6c-83ee-78c30f0284f8 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:43.675342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a394d36-f73f-4b6c-83ee-78c30f0284f8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:43.675342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a394d36-f73f-4b6c-83ee-78c30f0284f8 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:43.677003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 741/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:01:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:01:43.686771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe05f7-4c2e-47a3-b8e6-7009753e6dd3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:43.686771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe05f7-4c2e-47a3-b8e6-7009753e6dd3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:43.686771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe05f7-4c2e-47a3-b8e6-7009753e6dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:43.705048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-cdbe05f7-4c2e-47a3-b8e6-7009753e6dd3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:43.706341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cdbe05f7-4c2e-47a3-b8e6-7009753e6dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:43.716148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 735/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:01:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:01:43.772986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a394d36-f73f-4b6c-83ee-78c30f0284f8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:43.775727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0a394d36-f73f-4b6c-83ee-78c30f0284f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:43.845018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a394d36-f73f-4b6c-83ee-78c30f0284f8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:43.850521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a62f0-0538-4d26-90b3-aa72d4860d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:43.851376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a62f0-0538-4d26-90b3-aa72d4860d9c service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:43.851666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a62f0-0538-4d26-90b3-aa72d4860d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:43.851950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a62f0-0538-4d26-90b3-aa72d4860d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:43.871593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a62f0-0538-4d26-90b3-aa72d4860d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:43.886747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a62f0-0538-4d26-90b3-aa72d4860d9c service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:43.899136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 742/1477] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:01:46.234897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43629-c16d-41ee-90c9-d1c41375f460 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:46.235407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43629-c16d-41ee-90c9-d1c41375f460 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:46.235407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43629-c16d-41ee-90c9-d1c41375f460 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:46.237418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 736/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 04:01:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:01:46.243565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f447b-142e-4571-928a-6d0bb2c3b6b7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:46.244581 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f447b-142e-4571-928a-6d0bb2c3b6b7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:46.244786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f447b-142e-4571-928a-6d0bb2c3b6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:46.263442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-741f447b-142e-4571-928a-6d0bb2c3b6b7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:46.264665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-741f447b-142e-4571-928a-6d0bb2c3b6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:46.272910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 743/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 04:01:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:46.329155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c379-8197-4c5c-973c-321f93e13e62 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:46.329441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c379-8197-4c5c-973c-321f93e13e62 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:46.329723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c379-8197-4c5c-973c-321f93e13e62 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:46.331602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 737/1480] 10.222.0.73 () {54 vars in 966 bytes} [Fri Aug 27 04:01:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:01:46.337013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcec7e-b563-42c6-ad6a-c76d4f020037 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:46.337334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcec7e-b563-42c6-ad6a-c76d4f020037 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:46.337692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcec7e-b563-42c6-ad6a-c76d4f020037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:46.356205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0afcec7e-b563-42c6-ad6a-c76d4f020037 None None] MFA Rules not processed for user `65d84bc451c5469b89788e179bfc4189`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:01:46.357467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0afcec7e-b563-42c6-ad6a-c76d4f020037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:01:46.364832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 744/1481] 10.222.0.73 () {58 vars in 1064 bytes} [Fri Aug 27 04:01:46 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:01:46.373872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891c379-8197-4c5c-973c-321f93e13e62 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:01:46.385989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891c379-8197-4c5c-973c-321f93e13e62 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:01:46.389950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ee1db-cc0b-490f-9fee-41bcf63a9c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:01:46.390632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ee1db-cc0b-490f-9fee-41bcf63a9c60 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:01:46.390916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ee1db-cc0b-490f-9fee-41bcf63a9c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:01:46.391193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ee1db-cc0b-490f-9fee-41bcf63a9c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:01:46.402024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ee1db-cc0b-490f-9fee-41bcf63a9c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:01:46.403938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ee1db-cc0b-490f-9fee-41bcf63a9c60 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:01:46.416081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 738/1482] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:01:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:11.309614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.310165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.310165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.344263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.345494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:11.357985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 745/1483] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:11.367710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cceb-a441-47e5-8d7c-7162b5cfc7e9 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.368264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cceb-a441-47e5-8d7c-7162b5cfc7e9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.368264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cceb-a441-47e5-8d7c-7162b5cfc7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.393840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2631cceb-a441-47e5-8d7c-7162b5cfc7e9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.395128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2631cceb-a441-47e5-8d7c-7162b5cfc7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:11.405323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 739/1484] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:11.409928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:11.421321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5ce03-2464-445a-95cb-7ed1edd47336 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:11.430142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:11.430861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.431147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.431425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.432166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:11.432478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:11.434110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:11.440144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254915e-914b-4e0b-9e51-f4e9b1b15db9 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.440438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254915e-914b-4e0b-9e51-f4e9b1b15db9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.440722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254915e-914b-4e0b-9e51-f4e9b1b15db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.476188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 746/1485] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:11.477166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a254915e-914b-4e0b-9e51-f4e9b1b15db9 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.478294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a254915e-914b-4e0b-9e51-f4e9b1b15db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:11.484927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:11.500055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede8b63-6cb3-45f9-a864-0d8ebfb610d2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:11.507684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 740/1486] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:11.512374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e483a-57f5-47fa-aba9-ca56eafe9916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:11.513064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e483a-57f5-47fa-aba9-ca56eafe9916 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.513352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e483a-57f5-47fa-aba9-ca56eafe9916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.513636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e483a-57f5-47fa-aba9-ca56eafe9916 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.514347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e483a-57f5-47fa-aba9-ca56eafe9916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:11.516184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11186c7-cea4-4ce4-b154-eb6d80d2e2a3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.516473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11186c7-cea4-4ce4-b154-eb6d80d2e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.516756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11186c7-cea4-4ce4-b154-eb6d80d2e2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.520256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e483a-57f5-47fa-aba9-ca56eafe9916 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:11.556250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a11186c7-cea4-4ce4-b154-eb6d80d2e2a3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.557839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a11186c7-cea4-4ce4-b154-eb6d80d2e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:11.568191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 741/1487] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:11.571391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.572188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.572942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.603646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.607678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:11.617765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 742/1488] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:11.618861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:11.629213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07cb9d-663c-44a5-ad3e-b8ebf28f823c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:11.638961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:11.639937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.640391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.640832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.641742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:11.642255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:11.644072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:11.649273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 747/1489] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:11.652104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.652404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.652686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.665094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 743/1490] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:11.666189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:11.682230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.684807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:11.684942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a23e9-172f-47ab-b37f-6685a403628b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:11.795933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a66a-6915-4330-bacc-2bbd0a92c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:11.796612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a66a-6915-4330-bacc-2bbd0a92c839 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.796896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a66a-6915-4330-bacc-2bbd0a92c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.797175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a66a-6915-4330-bacc-2bbd0a92c839 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.797871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a66a-6915-4330-bacc-2bbd0a92c839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:11.799897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a66a-6915-4330-bacc-2bbd0a92c839 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:11.800026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 748/1491] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:11.800800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:11.813550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cd8b2-21fe-4e6a-a29d-348b8d689c2b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:11.819174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:11.820116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.820401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.820678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.821422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:11.823364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:11.976907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 744/1492] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:11.978170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5653-70e8-4da9-867a-8f4b30ffd90a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:11.978460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5653-70e8-4da9-867a-8f4b30ffd90a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:11.978756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5653-70e8-4da9-867a-8f4b30ffd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:11.998328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-911e5653-70e8-4da9-867a-8f4b30ffd90a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:11.999620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-911e5653-70e8-4da9-867a-8f4b30ffd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.008025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 745/1493] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.009271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f59b9c-417a-4669-87e0-6146d7b358c5 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.009567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f59b9c-417a-4669-87e0-6146d7b358c5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.011695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f59b9c-417a-4669-87e0-6146d7b358c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.027235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d4f59b9c-417a-4669-87e0-6146d7b358c5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.028477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d4f59b9c-417a-4669-87e0-6146d7b358c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.036909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 746/1494] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.039367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0472-8066-4c8f-bed4-3aa5cea49ee3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.042279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0472-8066-4c8f-bed4-3aa5cea49ee3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.042279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0472-8066-4c8f-bed4-3aa5cea49ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.064281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-311c0472-8066-4c8f-bed4-3aa5cea49ee3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.065590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-311c0472-8066-4c8f-bed4-3aa5cea49ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.074382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 747/1495] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.075595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef057f-8c08-4d16-b77b-6592f2163c5e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.075892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef057f-8c08-4d16-b77b-6592f2163c5e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.076253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef057f-8c08-4d16-b77b-6592f2163c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.090674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 749/1496] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:11 2021] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:12.092018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.095442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c2ef057f-8c08-4d16-b77b-6592f2163c5e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.096643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c2ef057f-8c08-4d16-b77b-6592f2163c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.155171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850ca6-51dd-4d66-a4f7-1db34f7a96f2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.159955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.160623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.160913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.161182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.161706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 748/1497] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.161988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:12.162974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.163764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add089-8bb2-4f0c-8c44-70be80e04c2e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.164052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add089-8bb2-4f0c-8c44-70be80e04c2e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.164326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add089-8bb2-4f0c-8c44-70be80e04c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.164650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.177091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 750/1498] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:12.178430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.184894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d4add089-8bb2-4f0c-8c44-70be80e04c2e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.186166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d4add089-8bb2-4f0c-8c44-70be80e04c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.188880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13698181-5bc9-4f60-bbf0-73ce80f08c07 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.193478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a5706-4c59-49bd-833d-f9c226d94f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.194298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a5706-4c59-49bd-833d-f9c226d94f29 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.194605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a5706-4c59-49bd-833d-f9c226d94f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.194886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a5706-4c59-49bd-833d-f9c226d94f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.195068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 749/1499] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.195639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a5706-4c59-49bd-833d-f9c226d94f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.196366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e35a79-7973-44e2-be74-6103cc939f40 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.196658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e35a79-7973-44e2-be74-6103cc939f40 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.196937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e35a79-7973-44e2-be74-6103cc939f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.197372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a5706-4c59-49bd-833d-f9c226d94f29 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.208929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 751/1500] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:12.210869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.211166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.211439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.223486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-21e35a79-7973-44e2-be74-6103cc939f40 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.225257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-21e35a79-7973-44e2-be74-6103cc939f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.229564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.230813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.233966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 750/1501] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.233966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110c99-b6b4-403b-8ff1-69d519329063 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.233966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110c99-b6b4-403b-8ff1-69d519329063 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.233966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110c99-b6b4-403b-8ff1-69d519329063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.242614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 752/1502] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.243401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.252532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d4a85-8895-4df3-8992-277873f42e85 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.254291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0e110c99-b6b4-403b-8ff1-69d519329063 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.255596 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0e110c99-b6b4-403b-8ff1-69d519329063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.257478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69559-6af2-4cda-9a50-69ef28fac1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.258138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69559-6af2-4cda-9a50-69ef28fac1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.258418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69559-6af2-4cda-9a50-69ef28fac1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.258721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69559-6af2-4cda-9a50-69ef28fac1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.259412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce69559-6af2-4cda-9a50-69ef28fac1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.261320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce69559-6af2-4cda-9a50-69ef28fac1d3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.264387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 751/1503] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.265459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.265750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.266030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.286024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.288016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.298818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 752/1504] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.299632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.312532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd4020-3c5b-46c3-93b3-77915c78e261 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.317712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.318399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.318723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.319001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.319697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.321847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.381990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 753/1505] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:12.383766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.384055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.384336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.403517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:12.404732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:12.412613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 754/1506] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:12.417654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.428674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1b661-d7dc-405d-8555-22f68f081c5a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.434365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.435137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.435414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.436095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.436778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.438304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.452281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 755/1507] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:12.459696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.459927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 753/1508] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:12.459927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.466048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd12e8-945f-45c7-96bd-a0ae0d2b1883 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.524481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.525158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.525441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.525719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.526456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:12.526793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.528423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.530032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c5642-274d-4a62-9ce1-ad4f97971b07 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.534939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.535615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.535898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.536170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.536929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:12.537260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.538961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.548384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 756/1509] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:12.548384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.552452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 754/1510] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:12.552669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e6c75-f2af-4163-868c-d325dc7f0585 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.553428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.557894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.558666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.558925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.559152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.559890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:12.560195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.561827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.564240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd138dc2-6b44-4d59-9dc8-550eeefd3cb6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.569234 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.570528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.570868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.571166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.571961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:12.572322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.574323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.578140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 757/1511] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:12.579029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.588890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 755/1512] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:12.589990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.601473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b785c-a654-4fad-a9e2-6b294eb59e26 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.601806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8aa09-7f75-44d3-8173-1cea3923cf22 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.607637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.608776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.608951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.609391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.609734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.609992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.610373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.610659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:12.610783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.611051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.611773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.612998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.614346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.625756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 758/1513] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:12.626776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.631075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 756/1514] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:12.641237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.641399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f061-c516-49e7-bd5c-33f6cc678e0c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.645628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.646328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.646638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.646914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.647600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.649776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0407c0-f127-4346-8fe4-f3e991c1cac5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.650297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.656104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.656999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.657292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.657551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] PATH_INFO: `/v3/projects/e703e80507d54e979104ab9b8ddc72b3/users/f04f8026377e4462b8341035eefd8d5a/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.672935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e703e80507d54e979104ab9b8ddc72b3, user_id=f04f8026377e4462b8341035eefd8d5a, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.675621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.776348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 759/1515] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:12.777656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.789803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb78d0b-2415-48cd-b587-278f8a9e9061 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.797396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.798074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.798361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.798670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.799433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.801767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.815162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 757/1516] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:12 2021] PUT /identity/v3/projects/e703e80507d54e979104ab9b8ddc72b3/users/f04f8026377e4462b8341035eefd8d5a/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:12.816291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.885716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450c966-80af-4a78-a591-e643519daa33 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.890735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.891540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.891710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.891952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.892650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:12.894588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:12.913620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 760/1517] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:12.914486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:12.988940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7f15f-bdfd-4ca5-87eb-4ceb24a625fb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:12.996443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:12.997179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:12.997453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:12.997735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:12.998446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.000466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.006085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 758/1518] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.006410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.077765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303394e1-e795-4ac8-a3a8-7f59d115a609 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.083132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.084059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.084345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.084713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.085431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.088319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.089251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 761/1519] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:12 2021] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.090191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.156307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdf59-f490-4e87-9de8-395842c04a5a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.161283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.162008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.162290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.162589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.163352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.165634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.177500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 762/1520] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:13 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:13.178336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.188830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d841fe2-fa12-429a-b1b3-199983ca8910 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.193816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c8b2e-0c0f-4313-9aed-1d598e46a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.194492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c8b2e-0c0f-4313-9aed-1d598e46a28d admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.194809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c8b2e-0c0f-4313-9aed-1d598e46a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.195622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c8b2e-0c0f-4313-9aed-1d598e46a28d admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.196395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c8b2e-0c0f-4313-9aed-1d598e46a28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.198346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c8b2e-0c0f-4313-9aed-1d598e46a28d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.256657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 759/1521] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.258023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.313748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 763/1522] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.315245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.315535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.315820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.316370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde8674-8e9a-4b41-856d-30517cf1a599 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.343673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] MFA Rules not processed for user `f04f8026377e4462b8341035eefd8d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:13.344924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:13.373187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.373946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.374291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.374670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.375397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.376995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.387793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 760/1523] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:13 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:13.388591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.397928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92443d77-fecb-4e27-8569-a0065cfe0c6c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.403375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.404038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.404317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.404590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.405295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.407284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.410287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 764/1524] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:13.411302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.422589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503eae-ac9a-4462-ae0d-acf68e603d71 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.430752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.430752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.430752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.430752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.431205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.431858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.575932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 761/1525] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.576748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.587043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0236-7717-4c00-a429-2a8154d59790 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.591752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.592411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.592697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.592972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.593658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.595886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.621011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 765/1526] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.621818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.631369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1856c-5e9f-421a-ab72-5cd91795c7e0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.636820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.637717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.637996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.638268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] PATH_INFO: `/v3/projects/c67ffd3553c245acabcdcfd5a15252e3/users/a21ac4ce459d4eee9f73d4c7207968b4/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.652854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67ffd3553c245acabcdcfd5a15252e3, user_id=a21ac4ce459d4eee9f73d4c7207968b4, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.655555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.775608 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 762/1527] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.776337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.785750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746c628-17b5-4442-96df-d83814353033 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.790749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.791415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.791691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.791969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.792697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.795039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.815010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 766/1528] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:13 2021] PUT /identity/v3/projects/c67ffd3553c245acabcdcfd5a15252e3/users/a21ac4ce459d4eee9f73d4c7207968b4/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:13.820728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.877891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a82f-73ee-4a42-9b52-6a103e14c352 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.883834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.884591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.884888 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.885175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.885863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.887852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.919080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 763/1529] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:13.920198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:13.930057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b31a91-56b4-46e7-92b6-4d5ad126ad80 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:13.934685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:13.935378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:13.935687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:13.935959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:13.936675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:13.938255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:13.949802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 764/1530] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:13.949802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.002933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a5c53-f511-4bd4-a5e6-cca7a877c4c1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.006791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61867440-3eb6-4919-8d8b-10d6c5d97af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.007539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61867440-3eb6-4919-8d8b-10d6c5d97af4 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.007960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61867440-3eb6-4919-8d8b-10d6c5d97af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.008246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61867440-3eb6-4919-8d8b-10d6c5d97af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.015518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 767/1531] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:13 2021] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:14.016353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.026489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8039cb-d649-4ab6-8500-0915ad8b7ac3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.031695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.032437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.032723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.033000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.033794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.035450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.046999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 768/1532] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.047911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.058276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5265-99d3-4553-84b4-a8c6f15f6178 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.063299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.063961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.064246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.064978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.065343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.066990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.067120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61867440-3eb6-4919-8d8b-10d6c5d97af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.068428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61867440-3eb6-4919-8d8b-10d6c5d97af4 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.077906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 769/1533] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.079185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.079392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 765/1534] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:13 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:14.080253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.080543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.080828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.091572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fd7c-e62e-4a0b-9fbc-0546bf900db6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.098827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.099922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.100400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.100877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.101119 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:14.103093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:14.103682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.105685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.111477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 766/1535] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:14.112318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.120230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 770/1536] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.127756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.127896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d21e4-9d8e-4652-bd4a-d13e0a3aa254 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.131432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a1d9f-0b48-4a1f-90d0-1d625417fe96 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.131866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.133816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.134194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.134572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.135404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.136291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.137182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.137298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.137470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.137750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] PATH_INFO: `/v3/projects/74bc40decbba46aba88aa9c29c8858d2/users/6463ded3d09e4dbd908f0d03b20e0555/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.151244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 767/1537] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.151244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.154274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bc40decbba46aba88aa9c29c8858d2, user_id=6463ded3d09e4dbd908f0d03b20e0555, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.157218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.161338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a75e4-7a6c-420a-9214-d8bcd7758548 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.167569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.181087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.181087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.181087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.181087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.181087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.183115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 768/1538] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.186691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.196702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53b66b-c574-483b-bf17-96ce41922159 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.201354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.202023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.202367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.202663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.203393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.205049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.215707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 769/1539] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.216527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.226085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e25f-ad92-42b1-a5b9-ee81488903d3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.231488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.232142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.232431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.232704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.233430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.235070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.245480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 771/1540] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:14 2021] PUT /identity/v3/projects/74bc40decbba46aba88aa9c29c8858d2/users/6463ded3d09e4dbd908f0d03b20e0555/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:14.246011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 770/1541] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.246335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.246933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.257697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81320d-cbe6-4303-a80c-50f18fc41f77 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.307124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6b58-adbf-4a19-a427-0dbdb9bd047b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.311316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.312117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.312415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.312727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.327439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.328407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.328696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.328975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.329747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.331620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.349320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 771/1542] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.349320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.365019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd909-eac5-4bfd-8974-933052abb9d9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.373642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.374813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.376160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.376160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.377023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.377887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.379471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.379985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.390172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 772/1543] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:14.391468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.395349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 772/1544] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.396238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.405634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7a0e-93a9-4dc3-9534-40489465b02a service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.406384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01835c7a-446f-42e1-90c7-91e74141bdd0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.411372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ae776-0ab8-4513-919a-b75d751f64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.411945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.412625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.412908 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.413281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ae776-0ab8-4513-919a-b75d751f64ef admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.413505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] PATH_INFO: `/v3/projects/b46f734eca6b4612aa25cae21f225e80/users/8e5e1225ae9f476181466c8b2b0cd998/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.413976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ae776-0ab8-4513-919a-b75d751f64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.414537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ae776-0ab8-4513-919a-b75d751f64ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.415847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ae776-0ab8-4513-919a-b75d751f64ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.418813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ae776-0ab8-4513-919a-b75d751f64ef admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.428667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46f734eca6b4612aa25cae21f225e80, user_id=8e5e1225ae9f476181466c8b2b0cd998, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.430011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 773/1545] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:14.431297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.431592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.431873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.432982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.449755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:14.451486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:14.458796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 774/1546] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:14.460490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.470517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf6410-eac6-41e0-a08b-6fdb917433e6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.475430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.476320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.476598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.476863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] PATH_INFO: `/v3/projects/d55ab7512eb147428ff65607b5c61b30/users/a83b237292ae4824ad8705549ca13e07/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.491288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55ab7512eb147428ff65607b5c61b30, user_id=a83b237292ae4824ad8705549ca13e07, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.494536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.543027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 773/1547] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:14 2021] PUT /identity/v3/projects/b46f734eca6b4612aa25cae21f225e80/users/8e5e1225ae9f476181466c8b2b0cd998/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:14.543879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.616053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 775/1548] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:14 2021] PUT /identity/v3/projects/d55ab7512eb147428ff65607b5c61b30/users/a83b237292ae4824ad8705549ca13e07/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:14.617571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.619326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758135bf-a6cd-4236-8a24-ab7a3548dea7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.685762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.686690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.686974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.687251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] PATH_INFO: `/v3/projects/1ee98f09292e42dcb6ce4eef97c4d47f/users/e66739aeb0cd4451be2b71b3a7745c31/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.692726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae0f23-2b1a-49bb-9a38-e5d3b0c9701e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.698232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.699274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.699570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.699839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] PATH_INFO: `/v3/projects/a2a4f9dd7d714d20afb13bd273d14061/users/3383e658085a4ae1ae783bc3e90e42b4/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.703346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee98f09292e42dcb6ce4eef97c4d47f, user_id=e66739aeb0cd4451be2b71b3a7745c31, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.706070 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.717647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a4f9dd7d714d20afb13bd273d14061, user_id=3383e658085a4ae1ae783bc3e90e42b4, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:14.720561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:14.871817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 776/1549] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:14 2021] PUT /identity/v3/projects/a2a4f9dd7d714d20afb13bd273d14061/users/3383e658085a4ae1ae783bc3e90e42b4/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:14.871817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.873707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 774/1550] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:14 2021] PUT /identity/v3/projects/1ee98f09292e42dcb6ce4eef97c4d47f/users/e66739aeb0cd4451be2b71b3a7745c31/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:14.874695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:14.938736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515119-4b72-4374-9ed3-52692e6f5fb4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:14.942993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ffa67-a08b-488a-9dfd-428c55d06c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:14.943655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ffa67-a08b-488a-9dfd-428c55d06c74 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:14.943944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ffa67-a08b-488a-9dfd-428c55d06c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:14.944222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ffa67-a08b-488a-9dfd-428c55d06c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:14.965744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4502ad-a9d8-45a7-905c-08fd875aff57 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.026630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ffa67-a08b-488a-9dfd-428c55d06c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.028283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ffa67-a08b-488a-9dfd-428c55d06c74 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.032222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6be72-0de8-4152-ae2b-e6ae010edb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.033149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6be72-0de8-4152-ae2b-e6ae010edb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.033438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6be72-0de8-4152-ae2b-e6ae010edb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.033701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6be72-0de8-4152-ae2b-e6ae010edb98 admin admin] PATH_INFO: `/v3/projects/5030fe8a997e416683658c321efaef5e/users/09ee35f66a4c4cb987f20990e974961f/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.048847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6be72-0de8-4152-ae2b-e6ae010edb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5030fe8a997e416683658c321efaef5e, user_id=09ee35f66a4c4cb987f20990e974961f, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.051561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6be72-0de8-4152-ae2b-e6ae010edb98 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.052291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 775/1551] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:15.055311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f1114-7cb8-4590-917a-abdb2dfbc525 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.056509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f1114-7cb8-4590-917a-abdb2dfbc525 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.057152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f1114-7cb8-4590-917a-abdb2dfbc525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.088307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-424f1114-7cb8-4590-917a-abdb2dfbc525 None None] MFA Rules not processed for user `8e5e1225ae9f476181466c8b2b0cd998`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:15.089555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-424f1114-7cb8-4590-917a-abdb2dfbc525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:15.173135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 777/1552] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:14 2021] PUT /identity/v3/projects/5030fe8a997e416683658c321efaef5e/users/09ee35f66a4c4cb987f20990e974961f/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:15.174600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0e471-c33b-495c-806a-09b9a7bf2ddd None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.174951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0e471-c33b-495c-806a-09b9a7bf2ddd None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.175321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0e471-c33b-495c-806a-09b9a7bf2ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.179076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 776/1553] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:15.181241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e1e12-c244-4361-9124-6b64ff9ef0d0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.182057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e1e12-c244-4361-9124-6b64ff9ef0d0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.182493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e1e12-c244-4361-9124-6b64ff9ef0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.208978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-671e1e12-c244-4361-9124-6b64ff9ef0d0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:15.210482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-671e1e12-c244-4361-9124-6b64ff9ef0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:15.236974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c1c0e471-c33b-495c-806a-09b9a7bf2ddd None None] MFA Rules not processed for user `a83b237292ae4824ad8705549ca13e07`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:15.238447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c1c0e471-c33b-495c-806a-09b9a7bf2ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:15.298960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 777/1554] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:15.303535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.303836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.304674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.308304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 778/1555] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:15.309925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a7501-860c-471d-98bd-7bcae289ee0f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.310274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a7501-860c-471d-98bd-7bcae289ee0f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.310725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a7501-860c-471d-98bd-7bcae289ee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.337205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ea3a7501-860c-471d-98bd-7bcae289ee0f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:15.338199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ea3a7501-860c-471d-98bd-7bcae289ee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:15.340919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] MFA Rules not processed for user `e66739aeb0cd4451be2b71b3a7745c31`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:15.342511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:15.349064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 779/1556] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:15.350977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd0f4-e441-485e-bf9d-5bc068622ae3 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.352644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd0f4-e441-485e-bf9d-5bc068622ae3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.353269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd0f4-e441-485e-bf9d-5bc068622ae3 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.363124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 780/1557] 10.222.0.73 () {54 vars in 961 bytes} [Fri Aug 27 04:03:15 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:03:15.364044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd0f4-e441-485e-bf9d-5bc068622ae3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:15.379159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd0f4-e441-485e-bf9d-5bc068622ae3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.384935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.385706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.386062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.386452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.387286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.389406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.425155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 778/1558] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:15.426181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:15.485804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251840-57ea-44f0-818a-b0d6cda9898f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.492254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 781/1559] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:15.493412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:15.570463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11607-bdb8-4256-ba5e-43c2922c6c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.571466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11607-bdb8-4256-ba5e-43c2922c6c81 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.571949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11607-bdb8-4256-ba5e-43c2922c6c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.572405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11607-bdb8-4256-ba5e-43c2922c6c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.608308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048822d-58bf-4716-aaec-7eb6ba94e575 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.614848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.616136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.616763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.617884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.642203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11607-bdb8-4256-ba5e-43c2922c6c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.643838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11607-bdb8-4256-ba5e-43c2922c6c81 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.657420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 779/1560] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:15.659893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f57b-7292-4dda-8987-257232379087 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.660562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f57b-7292-4dda-8987-257232379087 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.661136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f57b-7292-4dda-8987-257232379087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.694372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-45a8f57b-7292-4dda-8987-257232379087 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:15.697222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-45a8f57b-7292-4dda-8987-257232379087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:15.709610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.712020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.724053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 782/1561] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:15.725057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:15.739183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02663285-c6de-4fb3-9536-716432f4df8c service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.745375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.746160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.746518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.746914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.747682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.749898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.825028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 780/1562] 10.222.0.73 () {58 vars in 1059 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:15.825874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8f57b-7292-4dda-8987-257232379087 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:15.836442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8f57b-7292-4dda-8987-257232379087 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.841044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.841724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.842340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.842340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.842973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:15.844902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:15.871883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 783/1563] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:15.871883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:15.943483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e63cc-6f36-4260-a3d0-7117dbeef306 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:15.950042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:15.950900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:15.952268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:15.952268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:15.986862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 781/1564] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:15.988691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.000359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502eb9d-7429-4ab1-9ba9-848813c6590c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.017127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.018842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.029524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 784/1565] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:16.030364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.099351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87ded6-4c2e-40d1-9a60-45dd2fffbf8c service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.105589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.106431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.106993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.107325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.108164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.110396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.112682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.113346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.113634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.113910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.114671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.116352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.137233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 785/1566] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:16 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:16.139206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.152108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2527c-cb70-44b9-9a8c-75e9a30c03d3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.157925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.158604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.158604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.158979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] PATH_INFO: `/v3/projects/ea89ba75e9fa44139e410c71a81e194f/users/443bd6e0f5aa4b469d447251277a5c6b/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.177324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea89ba75e9fa44139e410c71a81e194f, user_id=443bd6e0f5aa4b469d447251277a5c6b, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.181170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.236278 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 782/1567] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:15 2021] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:16.239975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.251169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5ffd-375a-475b-90d8-28ca17f23b94 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.256748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.257469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.257751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.258032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.258952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.264895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.275962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 783/1568] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:16 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:16.276916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.287888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12e6b-8b1a-4f8c-a404-0628760d6cd5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.293599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 786/1569] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:16 2021] PUT /identity/v3/projects/ea89ba75e9fa44139e410c71a81e194f/users/443bd6e0f5aa4b469d447251277a5c6b/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:16.297047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.373734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cad4a-a8bc-4227-a562-9e65b2d75eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.374717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cad4a-a8bc-4227-a562-9e65b2d75eed admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.375059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cad4a-a8bc-4227-a562-9e65b2d75eed admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.381273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cad4a-a8bc-4227-a562-9e65b2d75eed admin admin] PATH_INFO: `/v3/projects/e9747c96b30149459a9a5e83ab0325b6/users/11ceb26158574b05a77044a75993d999/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.384947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dddc9-90aa-4397-a92d-e6c6251ff6a3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.391992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cad4a-a8bc-4227-a562-9e65b2d75eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9747c96b30149459a9a5e83ab0325b6, user_id=11ceb26158574b05a77044a75993d999, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.392444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614f75a-75bb-42c4-a8da-80e7264f94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.393199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614f75a-75bb-42c4-a8da-80e7264f94e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.393549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614f75a-75bb-42c4-a8da-80e7264f94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.393894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614f75a-75bb-42c4-a8da-80e7264f94e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.394720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614f75a-75bb-42c4-a8da-80e7264f94e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.395390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cad4a-a8bc-4227-a562-9e65b2d75eed admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.396459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614f75a-75bb-42c4-a8da-80e7264f94e7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.411093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 787/1570] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:16 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:16.411093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6e5a-276d-45af-a40e-fc4419c176d7 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.411093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6e5a-276d-45af-a40e-fc4419c176d7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.411093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a6e5a-276d-45af-a40e-fc4419c176d7 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.411722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 788/1571] 10.222.0.73 () {54 vars in 912 bytes} [Fri Aug 27 04:03:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:03:16.412401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a6e5a-276d-45af-a40e-fc4419c176d7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.427612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a6e5a-276d-45af-a40e-fc4419c176d7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.434154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc441ad-d5b5-45c0-aee9-de1b3c8e7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.435094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc441ad-d5b5-45c0-aee9-de1b3c8e7952 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.435371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc441ad-d5b5-45c0-aee9-de1b3c8e7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.435644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc441ad-d5b5-45c0-aee9-de1b3c8e7952 admin admin] PATH_INFO: `/v3/projects/ea89ba75e9fa44139e410c71a81e194f/users/443bd6e0f5aa4b469d447251277a5c6b/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.438039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc441ad-d5b5-45c0-aee9-de1b3c8e7952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea89ba75e9fa44139e410c71a81e194f, user_id=443bd6e0f5aa4b469d447251277a5c6b, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.440733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc441ad-d5b5-45c0-aee9-de1b3c8e7952 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.472253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 789/1572] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:16 2021] PUT /identity/v3/projects/ea89ba75e9fa44139e410c71a81e194f/users/443bd6e0f5aa4b469d447251277a5c6b/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:16.472253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.472253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.472253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.497760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:16.499061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:16.530509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 784/1573] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:16 2021] PUT /identity/v3/projects/e9747c96b30149459a9a5e83ab0325b6/users/11ceb26158574b05a77044a75993d999/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:16.533006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.533491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.534014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.563742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] MFA Rules not processed for user `443bd6e0f5aa4b469d447251277a5c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:16.564960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:16.593498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 790/1574] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:03:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:16.594943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.632506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 785/1575] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:16 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:16.633372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.667566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65040386-5d03-41e7-9776-08c66b8cd81f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.698018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189c43e-16a2-4e32-ac5e-0702371887aa None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.702305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.702922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.703202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.703537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.733557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.734298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.734614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.734896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.736069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.738650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.749792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 791/1576] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:16 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:16.750776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.764226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891b13-fcbe-4a5f-9560-1ef93aff0261 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.768733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d7bb3-d3ea-4754-bfb4-d0beb3efa213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.774409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7bb3-d3ea-4754-bfb4-d0beb3efa213 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.774409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7bb3-d3ea-4754-bfb4-d0beb3efa213 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.774409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7bb3-d3ea-4754-bfb4-d0beb3efa213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.781832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d7bb3-d3ea-4754-bfb4-d0beb3efa213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.783700 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d7bb3-d3ea-4754-bfb4-d0beb3efa213 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.792285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.793876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.796809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 792/1577] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:16 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:16.798266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb89f-4c16-48d9-b0e3-d6e3cfc47597 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.803531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb89f-4c16-48d9-b0e3-d6e3cfc47597 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.803531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb89f-4c16-48d9-b0e3-d6e3cfc47597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.812332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 786/1578] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:16.813637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:16.828110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91b101-9679-49ff-a644-efaa67c0e75d service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:16.837691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6e4eb89f-4c16-48d9-b0e3-d6e3cfc47597 None None] MFA Rules not processed for user `a21ac4ce459d4eee9f73d4c7207968b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:16.839415 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6e4eb89f-4c16-48d9-b0e3-d6e3cfc47597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:16.847444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad413d03-58ee-4a49-b3a3-d91e83dc72c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:16.848707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad413d03-58ee-4a49-b3a3-d91e83dc72c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.849083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad413d03-58ee-4a49-b3a3-d91e83dc72c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.849570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad413d03-58ee-4a49-b3a3-d91e83dc72c0 admin admin] PATH_INFO: `/v3/projects/e9747c96b30149459a9a5e83ab0325b6/users/11ceb26158574b05a77044a75993d999/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.852353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad413d03-58ee-4a49-b3a3-d91e83dc72c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9747c96b30149459a9a5e83ab0325b6, user_id=11ceb26158574b05a77044a75993d999, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:16.856081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad413d03-58ee-4a49-b3a3-d91e83dc72c0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:16.878880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 787/1579] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:16 2021] PUT /identity/v3/projects/e9747c96b30149459a9a5e83ab0325b6/users/11ceb26158574b05a77044a75993d999/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:16.881067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:16.881067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:16.884374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:16.926993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] MFA Rules not processed for user `11ceb26158574b05a77044a75993d999`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:16.926993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:16.990855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 793/1580] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:17.011301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29a43-6511-46b6-9da4-82a6a1ca4375 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.018805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29a43-6511-46b6-9da4-82a6a1ca4375 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.018805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29a43-6511-46b6-9da4-82a6a1ca4375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.033619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 788/1581] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:16 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:17.048805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f7b29a43-6511-46b6-9da4-82a6a1ca4375 None None] MFA Rules not processed for user `a21ac4ce459d4eee9f73d4c7207968b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:17.050049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f7b29a43-6511-46b6-9da4-82a6a1ca4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:17.053728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:17.121718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 794/1582] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:17 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:17.137019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f28a-5201-4bf3-9e67-ece509703791 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:17.146026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e72b-8436-48bf-b9b6-024e52c538e9 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.147272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e72b-8436-48bf-b9b6-024e52c538e9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.147418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e72b-8436-48bf-b9b6-024e52c538e9 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.150537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 795/1583] 10.222.0.73 () {54 vars in 961 bytes} [Fri Aug 27 04:03:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:03:17.157135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.157135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.157359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.161027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:17.162317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.162861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.167795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.176926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:17.178644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:17.183748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:17.185863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:17.194175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 789/1584] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:17 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:17.329918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 796/1585] 10.222.0.73 () {58 vars in 1059 bytes} [Fri Aug 27 04:03:17 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:17.341000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:17.363672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafb0d-767a-4432-92a6-6a19a57e1555 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:17.371629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc4c7a-58a8-420c-8a9b-fb6b87d95816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:17.372555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc4c7a-58a8-420c-8a9b-fb6b87d95816 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.373283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc4c7a-58a8-420c-8a9b-fb6b87d95816 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.373713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc4c7a-58a8-420c-8a9b-fb6b87d95816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.385595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc4c7a-58a8-420c-8a9b-fb6b87d95816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:17.388115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc4c7a-58a8-420c-8a9b-fb6b87d95816 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:17.415983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 790/1586] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:17 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:17.608926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:17.622829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61d70-fd37-4e53-856a-f3d45d6c0c4f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:17.627459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500991-ffc4-47b9-8a09-e7d894bd6c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:17.628118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500991-ffc4-47b9-8a09-e7d894bd6c46 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.628428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500991-ffc4-47b9-8a09-e7d894bd6c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.628704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500991-ffc4-47b9-8a09-e7d894bd6c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.687149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85500991-ffc4-47b9-8a09-e7d894bd6c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:17.688651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85500991-ffc4-47b9-8a09-e7d894bd6c46 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:17.697966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 797/1587] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:17 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:17.698533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7536d-c015-4572-9f0d-413568b8b351 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.698976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7536d-c015-4572-9f0d-413568b8b351 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.699163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7536d-c015-4572-9f0d-413568b8b351 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.701168 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 791/1588] 10.222.0.73 () {54 vars in 912 bytes} [Fri Aug 27 04:03:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:03:17.706860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eabeb-8809-4de2-bd0e-24f544df1057 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.709510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eabeb-8809-4de2-bd0e-24f544df1057 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.709510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eabeb-8809-4de2-bd0e-24f544df1057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.746631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fa4eabeb-8809-4de2-bd0e-24f544df1057 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:17.747876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fa4eabeb-8809-4de2-bd0e-24f544df1057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:17.761994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 798/1589] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:03:17 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:17.800392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7536d-c015-4572-9f0d-413568b8b351 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:17.803107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cce7536d-c015-4572-9f0d-413568b8b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:17.882508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7536d-c015-4572-9f0d-413568b8b351 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:17.886773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098be3c-e56f-4650-b3bb-4c8d5bac661d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:17.887493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098be3c-e56f-4650-b3bb-4c8d5bac661d service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:17.888274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098be3c-e56f-4650-b3bb-4c8d5bac661d service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:17.888274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098be3c-e56f-4650-b3bb-4c8d5bac661d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:17.924742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098be3c-e56f-4650-b3bb-4c8d5bac661d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:17.926879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098be3c-e56f-4650-b3bb-4c8d5bac661d service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:17.941532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 792/1590] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:18.381446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c14f0-e459-4e35-8187-9ff18d052e2d None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:18.381849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c14f0-e459-4e35-8187-9ff18d052e2d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:18.382349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c14f0-e459-4e35-8187-9ff18d052e2d None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:18.386868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 799/1591] 10.222.0.73 () {54 vars in 912 bytes} [Fri Aug 27 04:03:18 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:03:18.396047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7378f-afcb-4238-9b95-ac9dff020591 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:18.396622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7378f-afcb-4238-9b95-ac9dff020591 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:18.397052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7378f-afcb-4238-9b95-ac9dff020591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:18.456547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-45c7378f-afcb-4238-9b95-ac9dff020591 None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:18.458591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-45c7378f-afcb-4238-9b95-ac9dff020591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:18.525975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 793/1592] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:03:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:18.540227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c14f0-e459-4e35-8187-9ff18d052e2d None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:18.553407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c14f0-e459-4e35-8187-9ff18d052e2d None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:18.560169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946a16-e868-4820-a546-47087ca08b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:18.562999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946a16-e868-4820-a546-47087ca08b21 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:18.562999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946a16-e868-4820-a546-47087ca08b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:18.562999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946a16-e868-4820-a546-47087ca08b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:18.573085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946a16-e868-4820-a546-47087ca08b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:18.575081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946a16-e868-4820-a546-47087ca08b21 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:18.585087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 800/1593] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:18 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:19.268933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884f22-b0c9-469c-9288-43bc6cf9deb3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.271591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884f22-b0c9-469c-9288-43bc6cf9deb3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.272305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884f22-b0c9-469c-9288-43bc6cf9deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.342753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-39884f22-b0c9-469c-9288-43bc6cf9deb3 None None] MFA Rules not processed for user `3383e658085a4ae1ae783bc3e90e42b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:19.344276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-39884f22-b0c9-469c-9288-43bc6cf9deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:19.380866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d032-8ea0-4fbb-977e-08bde8e65d7b None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.384003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d032-8ea0-4fbb-977e-08bde8e65d7b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.384003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5d032-8ea0-4fbb-977e-08bde8e65d7b None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.384759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 801/1594] 10.222.0.73 () {54 vars in 960 bytes} [Fri Aug 27 04:03:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:03:19.390847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.391139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.391411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.435955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] MFA Rules not processed for user `4b134c117c9843509b5e8fa587ab484e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:19.443434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:19.487978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 794/1595] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:19.492557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.492848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.493181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.520726 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] MFA Rules not processed for user `3383e658085a4ae1ae783bc3e90e42b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:19.521987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:19.542032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 795/1596] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:19.545572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:19.587500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 802/1597] 10.222.0.73 () {58 vars in 1058 bytes} [Fri Aug 27 04:03:19 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:19.588481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:19.605026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0b6c-2a33-45b8-88c5-1e3bdd54e344 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:19.611228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:19.611904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.612241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.612528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.622539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:19.626596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:19.635608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 803/1598] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:19 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:19.636558 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:19.648393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de042-ccab-4370-b5af-fe0e554e09ac service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:19.651211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d869c5-aa31-4135-98ae-8b9504edc123 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:19.654468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:19.654949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443bd6e0f5aa4b469d447251277a5c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea89ba75e9fa44139e410c71a81e194f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:19.655153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.655441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.655712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.657511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:19.670859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.671092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:19.672044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.672245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.672442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:19.673023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:19.673339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:19.678815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:19.685907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 804/1599] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:19 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:19.717639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 796/1600] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:19.721210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:19.736994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da1164-4f50-4a8f-95ce-0c2f1adba9d4 service placement] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:19.748947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443bd6e0f5aa4b469d447251277a5c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea89ba75e9fa44139e410c71a81e194f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:19.753360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:19.754978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:19.755989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:19.758292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:19.763271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:19.896279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 805/1601] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:19 2021] POST /identity/v3/projects => generated 353 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:19.900843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:19.917077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90426-05ab-4de4-a53b-e46983e81a40 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:20.024587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443bd6e0f5aa4b469d447251277a5c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea89ba75e9fa44139e410c71a81e194f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:20.024807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:20.025587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:20.025587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:20.026155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:20.026396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:20.028603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:20.059388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 797/1602] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:20.185099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:20.208403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc08fa-5793-4890-9e71-470deda7d318 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:20.248635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443bd6e0f5aa4b469d447251277a5c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea89ba75e9fa44139e410c71a81e194f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:20.261629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:20.261629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:20.261629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] PATH_INFO: `/v3/projects/dc45a02f6b8d4674adad22e6158d4492` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:20.271757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc45a02f6b8d4674adad22e6158d4492)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:20.278921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: WARNING py.warnings [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:20.278921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: warnings.warn(msg) Aug 27 04:03:20.278921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: Aug 27 04:03:20.281677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:20.489029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc45a02f6b8d4674adad22e6158d4492', 'request_id': 'req-819f3800-8a81-4010-b63e-52eba52987c6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:20.557445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc45a02f6b8d4674adad22e6158d4492', 'request_id': 'req-819f3800-8a81-4010-b63e-52eba52987c6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:20.566099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc45a02f6b8d4674adad22e6158d4492', 'request_id': 'req-819f3800-8a81-4010-b63e-52eba52987c6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:20.640017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] The token cache is being invalidate because project dc45a02f6b8d4674adad22e6158d4492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:20.640336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:20.641459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-819f3800-8a81-4010-b63e-52eba52987c6 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:20.642884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 806/1603] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:20 2021] DELETE /identity/v3/projects/dc45a02f6b8d4674adad22e6158d4492 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:22.060424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:22.062254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:22.249925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad95c-5198-48ea-8007-543fe2974331 tempest-VolumeQuotaClassesTest-663007120 tempest-VolumeQuotaClassesTest-663007120-project-admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:22.374423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:22.375357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:22.375829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:22.376117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] PATH_INFO: `/v3/users/a83b237292ae4824ad8705549ca13e07` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:22.377564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83b237292ae4824ad8705549ca13e07)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:22.378622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: WARNING py.warnings [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:22.378622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: warnings.warn(msg) Aug 27 04:03:22.378622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: Aug 27 04:03:22.380324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:22.688856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83b237292ae4824ad8705549ca13e07'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:22.832690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83b237292ae4824ad8705549ca13e07'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:22.908673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83b237292ae4824ad8705549ca13e07'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:22.911290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83b237292ae4824ad8705549ca13e07'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:22.921771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83b237292ae4824ad8705549ca13e07'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:22.958924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 798/1604] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:22 2021] DELETE /identity/v3/users/a83b237292ae4824ad8705549ca13e07 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:22.963402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:22.964254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:22.964693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:22.998396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:22.999898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:23.113509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 807/1605] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:23.133436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:23.136059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:23.332144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d7283-4f52-402e-9131-d0ed5914cf37 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:23.340483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:23.341380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:23.341890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:23.348490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:23.404122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:23.405877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:23.436499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 799/1606] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:24.645934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:24.648530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:24.696486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922da6b-7f5c-4434-9f09-7b78ff2d4372 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:24.717189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:24.718088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:24.718615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:24.719106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] PATH_INFO: `/v3/users/e66739aeb0cd4451be2b71b3a7745c31` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:24.721269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66739aeb0cd4451be2b71b3a7745c31)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:24.723514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:24.813467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:24.816071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:24.839801 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6956-5a59-46a6-aed0-4b85ae373628 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:24.846162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:24.847210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:24.847682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:24.848111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] PATH_INFO: `/v3/projects/d55ab7512eb147428ff65607b5c61b30` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:24.849760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55ab7512eb147428ff65607b5c61b30)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:24.852604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:24.971396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66739aeb0cd4451be2b71b3a7745c31'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:24.981030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66739aeb0cd4451be2b71b3a7745c31'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.089386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55ab7512eb147428ff65607b5c61b30', 'request_id': 'req-e4f4b706-de62-4b43-b651-f01fba474c5e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.106113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66739aeb0cd4451be2b71b3a7745c31'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.106775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66739aeb0cd4451be2b71b3a7745c31'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.111347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55ab7512eb147428ff65607b5c61b30', 'request_id': 'req-e4f4b706-de62-4b43-b651-f01fba474c5e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.139413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f697d64a-2381-4993-a489-cdc178b2ee79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66739aeb0cd4451be2b71b3a7745c31'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.176546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 808/1607] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:24 2021] DELETE /identity/v3/users/e66739aeb0cd4451be2b71b3a7745c31 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:25.182480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:25.182480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:25.187265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:25.224818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55ab7512eb147428ff65607b5c61b30', 'request_id': 'req-e4f4b706-de62-4b43-b651-f01fba474c5e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.244136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:25.248195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:25.249546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] The token cache is being invalidate because project d55ab7512eb147428ff65607b5c61b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:25.250016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.250914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:25.252672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 800/1608] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:24 2021] DELETE /identity/v3/projects/d55ab7512eb147428ff65607b5c61b30 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:25.274408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:25.275467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:25.358052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 809/1609] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:25.405709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:25.407607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:25.504640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b706-de62-4b43-b651-f01fba474c5e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:25.511447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:25.512861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:25.513294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:25.513720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] PATH_INFO: `/v3/users/443bd6e0f5aa4b469d447251277a5c6b` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:25.543476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443bd6e0f5aa4b469d447251277a5c6b)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:25.557015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5625df3-28ca-4713-b391-8dc55d339413 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:25.559941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:25.566389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9ea25-8d9a-4195-94fc-dcfa5cc15e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:25.568958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9ea25-8d9a-4195-94fc-dcfa5cc15e3b service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:25.573100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9ea25-8d9a-4195-94fc-dcfa5cc15e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:25.573872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9ea25-8d9a-4195-94fc-dcfa5cc15e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:25.599316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9ea25-8d9a-4195-94fc-dcfa5cc15e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:25.603157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9ea25-8d9a-4195-94fc-dcfa5cc15e3b service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:25.620333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 810/1610] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:25.888277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443bd6e0f5aa4b469d447251277a5c6b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:26.009582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443bd6e0f5aa4b469d447251277a5c6b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:26.026388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443bd6e0f5aa4b469d447251277a5c6b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:26.027597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443bd6e0f5aa4b469d447251277a5c6b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:26.028544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7dfa02fb-21fd-47cf-a534-0d518621f9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443bd6e0f5aa4b469d447251277a5c6b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:26.077215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 801/1611] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:25 2021] DELETE /identity/v3/users/443bd6e0f5aa4b469d447251277a5c6b => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:26.915475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:26.916140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:26.916140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:26.992183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] MFA Rules not processed for user `09ee35f66a4c4cb987f20990e974961f`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:26.994478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.009187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2881-937d-4aef-b9d2-9c4af5577b51 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.009957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2881-937d-4aef-b9d2-9c4af5577b51 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.009957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2881-937d-4aef-b9d2-9c4af5577b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.076618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c7ab2881-937d-4aef-b9d2-9c4af5577b51 None None] MFA Rules not processed for user `6463ded3d09e4dbd908f0d03b20e0555`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:27.095218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c7ab2881-937d-4aef-b9d2-9c4af5577b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.127168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 811/1612] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:26 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:27.128250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:27.130256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.262276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 802/1613] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:27 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:27.262276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.262276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.262276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.262896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94716-d227-4ae6-b9fc-0947bff147ae None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:27.269035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:27.269975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.270259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.270536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] PATH_INFO: `/v3/projects/1ee98f09292e42dcb6ce4eef97c4d47f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.271826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee98f09292e42dcb6ce4eef97c4d47f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:27.275025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:27.290104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] MFA Rules not processed for user `09ee35f66a4c4cb987f20990e974961f`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:27.291507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.299452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 803/1614] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:27 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:27.300452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:27.301800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.317961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deeb05-74f8-4bf9-8012-2ff08d44bf61 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:27.323695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:27.324571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.324885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.325201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] PATH_INFO: `/v3/projects/ea89ba75e9fa44139e410c71a81e194f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.326374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea89ba75e9fa44139e410c71a81e194f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:27.328479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:27.409907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee98f09292e42dcb6ce4eef97c4d47f', 'request_id': 'req-d2fdbf35-50f1-43c5-aacb-003c668f2665'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.461483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea89ba75e9fa44139e410c71a81e194f', 'request_id': 'req-ea9cef23-8d9b-4add-82d9-b7c666c337f1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.467719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea89ba75e9fa44139e410c71a81e194f', 'request_id': 'req-ea9cef23-8d9b-4add-82d9-b7c666c337f1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.506321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee98f09292e42dcb6ce4eef97c4d47f', 'request_id': 'req-d2fdbf35-50f1-43c5-aacb-003c668f2665'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.513389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee98f09292e42dcb6ce4eef97c4d47f', 'request_id': 'req-d2fdbf35-50f1-43c5-aacb-003c668f2665'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.526492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] The token cache is being invalidate because project 1ee98f09292e42dcb6ce4eef97c4d47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:27.527405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.528207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.530275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 812/1615] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:27 2021] DELETE /identity/v3/projects/1ee98f09292e42dcb6ce4eef97c4d47f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:27.531584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:27.533638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.605117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea89ba75e9fa44139e410c71a81e194f', 'request_id': 'req-ea9cef23-8d9b-4add-82d9-b7c666c337f1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.617518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] The token cache is being invalidate because project ea89ba75e9fa44139e410c71a81e194f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:27.619501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.619501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:27.620788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 804/1616] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:27 2021] DELETE /identity/v3/projects/ea89ba75e9fa44139e410c71a81e194f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:27.621291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:27.623403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.632097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdbf35-50f1-43c5-aacb-003c668f2665 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:27.714461 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:27.715641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.716091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.716544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.719924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.720167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cef23-8d9b-4add-82d9-b7c666c337f1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:27.739856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:27.742845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.743139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.743416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.746080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.798084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:27.799776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:27.809954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 813/1617] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:27 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:27.810722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:27.812036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.815969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:27.818255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c4eb2-0c4a-4f55-ae3a-085ac6baf04d service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:27.828829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 805/1618] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:27 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:27.830344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce568b4-8061-42d4-86d0-f637aaf631a5 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.830730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce568b4-8061-42d4-86d0-f637aaf631a5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.831095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce568b4-8061-42d4-86d0-f637aaf631a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.854041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4ce568b4-8061-42d4-86d0-f637aaf631a5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:27.855950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4ce568b4-8061-42d4-86d0-f637aaf631a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:27.946549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b992e1-bf85-4a17-8100-097f0c5564bd service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:27.957881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:27.959110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.959565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.960317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] PATH_INFO: `/v3/users/11ceb26158574b05a77044a75993d999` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:27.961901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ceb26158574b05a77044a75993d999)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:27.964099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:27.969407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 806/1619] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:27.978651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:27.978651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:27.978651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:28.012175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:28.015024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:28.027994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 807/1620] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:28.034814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:28.047860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0a27-a9ca-4a57-b2a6-7c4a14f9e044 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:28.060917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:28.062401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:28.062923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:28.063416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:28.064674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:28.064993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:28.067841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:28.094420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 808/1621] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:28.098401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:28.121264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc163a8-6d62-4018-8bbd-3101f2f9d103 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:28.127433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:28.129374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:28.129374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:28.129374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:28.130758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:28.133276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:28.234941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ceb26158574b05a77044a75993d999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:28.235635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ceb26158574b05a77044a75993d999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:28.273057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 809/1622] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:28 2021] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:28.274286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:28.323266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ceb26158574b05a77044a75993d999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:28.324671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ceb26158574b05a77044a75993d999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:28.348090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ceb26158574b05a77044a75993d999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:28.389431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 814/1623] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:27 2021] DELETE /identity/v3/users/11ceb26158574b05a77044a75993d999 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:28.416989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d25ead-6347-4e7c-ac8a-d0f196e6e7d8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:28.581082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:28.582002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:28.584528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:28.585008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:28.585970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:28.588880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:29.425434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 810/1624] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:28 2021] POST /identity/v3/users => generated 281 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:29.432580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:29.432580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:29.432580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4df8-7032-404b-9c49-7dda0fe2e7e3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:29.436093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:29.436093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:29.436093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:29.436093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:29.437016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:29.437016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:29.437016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 815/1625] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:28 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:29.438951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:29.438951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188c93-31ed-4978-b155-e8d8a2676cf2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:29.438951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98d416-bb8e-4764-aad6-8dae133b6bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:29.438951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d416-bb8e-4764-aad6-8dae133b6bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:29.439434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d416-bb8e-4764-aad6-8dae133b6bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:29.439434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d416-bb8e-4764-aad6-8dae133b6bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:29.439434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98d416-bb8e-4764-aad6-8dae133b6bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:29.439434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98d416-bb8e-4764-aad6-8dae133b6bb8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:29.439434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 811/1626] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:28 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:29.439783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:29.439783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ba19-bbbb-4c8d-a992-89442d25709e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:29.439783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6766cc-5058-4118-803c-9ecb6cb539c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:29.439783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6766cc-5058-4118-803c-9ecb6cb539c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:29.440105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6766cc-5058-4118-803c-9ecb6cb539c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:29.440105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6766cc-5058-4118-803c-9ecb6cb539c0 admin admin] PATH_INFO: `/v3/projects/eb3c35249af94c46b9f113607421db94/users/cd25cc80d6d14637b6043ccf3b665d70/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:29.440105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6766cc-5058-4118-803c-9ecb6cb539c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3c35249af94c46b9f113607421db94, user_id=cd25cc80d6d14637b6043ccf3b665d70, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:29.440105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6766cc-5058-4118-803c-9ecb6cb539c0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:29.440105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 816/1627] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:28 2021] PUT /identity/v3/projects/eb3c35249af94c46b9f113607421db94/users/cd25cc80d6d14637b6043ccf3b665d70/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:29.496204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:29.496509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:29.496793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:29.577139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] MFA Rules not processed for user `cd25cc80d6d14637b6043ccf3b665d70`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:29.579471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:29.709907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:29.710159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:29.710748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:29.778301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] MFA Rules not processed for user `09ee35f66a4c4cb987f20990e974961f`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:29.781719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:29.883517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 812/1628] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:29 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:29.921146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:29.927288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:30.083824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00bd9-5074-4723-a3eb-4dc6d05697ac None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:30.091507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014311c4-692c-454e-bd3a-5d5b39ded835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:30.092187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014311c4-692c-454e-bd3a-5d5b39ded835 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:30.092474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014311c4-692c-454e-bd3a-5d5b39ded835 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:30.092782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014311c4-692c-454e-bd3a-5d5b39ded835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:30.103043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 817/1629] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:29 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:30.115624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014311c4-692c-454e-bd3a-5d5b39ded835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:30.117450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014311c4-692c-454e-bd3a-5d5b39ded835 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:30.168697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 813/1630] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:29 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:30.187525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:30.338761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ff598-06ac-474f-aafa-22d7589326cc None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:30.362978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:30.364118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:30.364410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:30.364691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] PATH_INFO: `/v3/users/cd25cc80d6d14637b6043ccf3b665d70` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:30.376525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd25cc80d6d14637b6043ccf3b665d70)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:30.378522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:30.625304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d76cd-284e-4ee9-b53d-b930bf10b33c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:30.625891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d76cd-284e-4ee9-b53d-b930bf10b33c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:30.625891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d76cd-284e-4ee9-b53d-b930bf10b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:30.665866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a04d76cd-284e-4ee9-b53d-b930bf10b33c None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:30.669106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a04d76cd-284e-4ee9-b53d-b930bf10b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:30.743684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd25cc80d6d14637b6043ccf3b665d70'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:30.744484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd25cc80d6d14637b6043ccf3b665d70'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:30.843283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd25cc80d6d14637b6043ccf3b665d70'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:30.843944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd25cc80d6d14637b6043ccf3b665d70'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:30.857279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd25cc80d6d14637b6043ccf3b665d70'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:30.887122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 818/1631] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:30 2021] DELETE /identity/v3/users/cd25cc80d6d14637b6043ccf3b665d70 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:30.889215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:30.900217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 814/1632] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:03:30 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 04:03:30.911567 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:30.914374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:30.915347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:30.915631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:30.992892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:30.994275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:31.053026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed9148-4231-4853-b2cd-96bc149cdf4b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:31.066708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:31.068265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:31.068265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:31.068265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] PATH_INFO: `/v3/projects/e9747c96b30149459a9a5e83ab0325b6` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:31.070505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9747c96b30149459a9a5e83ab0325b6)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:31.072651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:31.191630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 815/1633] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:31.259525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9747c96b30149459a9a5e83ab0325b6', 'request_id': 'req-0f601645-589c-40b2-9b69-8f02cad6db7a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:31.273829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:31.277845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:31.415607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9747c96b30149459a9a5e83ab0325b6', 'request_id': 'req-0f601645-589c-40b2-9b69-8f02cad6db7a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:31.430617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9747c96b30149459a9a5e83ab0325b6', 'request_id': 'req-0f601645-589c-40b2-9b69-8f02cad6db7a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:31.477114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] The token cache is being invalidate because project e9747c96b30149459a9a5e83ab0325b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:31.477114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:31.477114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:31.494865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 819/1634] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:30 2021] DELETE /identity/v3/projects/e9747c96b30149459a9a5e83ab0325b6 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:31.496320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:31.537461 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:31.547114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263dc60-d3d4-4c61-bc41-25f676976c24 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:31.728033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:31.729141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:31.729689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:31.730136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:31.730545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f601645-589c-40b2-9b69-8f02cad6db7a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:31.743751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:31.744110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:31.744911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:31.745195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:31.745599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:31.748417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:31.936186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:31.940065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f51cd3-c000-4970-ab76-f2dd575fabc9 service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:31.962065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:31.964428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb85ea4-0a56-4881-a864-30034f2c0009 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:31.990191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 820/1635] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:03:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:32.003119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:32.008509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:32.008509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:32.008752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 816/1636] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:32.067400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:32.076772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:32.108323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 821/1637] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:32.109566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:32.109878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:32.110246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:32.163917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:32.171301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:32.202050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 817/1638] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:32.207059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:32.223771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142ba87-3fff-4254-a22b-cc4d24918724 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:32.246501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:32.248099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:32.248099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:32.248099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:32.256898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:32.257686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:32.263770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:32.317869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 822/1639] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:32.319756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:32.348630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72ee88-0ffc-4bd9-974a-fb7736f5801a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:32.367491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:32.368192 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:32.368478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:32.370396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:32.373438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:32.378072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:32.541923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:32.549537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 818/1640] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:32 2021] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:32.566320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ac20c-e469-47f9-858d-60ca881c8092 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:32.835390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:32.836355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:32.840916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:32.841291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:32.842049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:32.844090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:32.992607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 823/1641] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:32 2021] POST /identity/v3/users => generated 294 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:32.999200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:33.038041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6171-2835-4c1f-a94d-78ed7c9bcfe1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:33.091922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:33.092625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:33.092914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:33.093191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:33.093946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:33.096173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:33.140224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:33.146449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 819/1642] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:32 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:33.162052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb891b21-3ba6-40c0-9907-704474193135 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:33.180051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeb8f0-e00c-4736-819d-9494b6459154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:33.180894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb8f0-e00c-4736-819d-9494b6459154 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:33.181185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb8f0-e00c-4736-819d-9494b6459154 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:33.181515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb8f0-e00c-4736-819d-9494b6459154 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:33.182262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeb8f0-e00c-4736-819d-9494b6459154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:33.185670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeb8f0-e00c-4736-819d-9494b6459154 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:33.223720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 824/1643] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:33 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:33.224083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:33.297314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d94eab-3db2-47ae-ab1d-1551a0c29797 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:33.315533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:33.316623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:33.317058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:33.317472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] PATH_INFO: `/v3/projects/beb00cc1b2394cb4b26c6c4c7e1d3983/users/f8e27c355e2543a58b07053ee7c841e9/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:33.368724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69337eb-80ea-473a-902b-2f600e433e6d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:33.369195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69337eb-80ea-473a-902b-2f600e433e6d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:33.369607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69337eb-80ea-473a-902b-2f600e433e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:33.383742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb00cc1b2394cb4b26c6c4c7e1d3983, user_id=f8e27c355e2543a58b07053ee7c841e9, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:33.388928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:33.396930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d69337eb-80ea-473a-902b-2f600e433e6d None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:33.399325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d69337eb-80ea-473a-902b-2f600e433e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:33.568526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 825/1644] 10.222.0.74 () {58 vars in 1016 bytes} [Fri Aug 27 04:03:33 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:33.583108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 820/1645] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:33 2021] PUT /identity/v3/projects/beb00cc1b2394cb4b26c6c4c7e1d3983/users/f8e27c355e2543a58b07053ee7c841e9/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:33.656202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:33.660944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:33.660944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:33.700881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] MFA Rules not processed for user `f8e27c355e2543a58b07053ee7c841e9`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:33.713659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:33.741678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:33.743700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:34.010921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72df3-8665-42ae-9780-ea01d355c92f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:34.019795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:34.031122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:34.031122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:34.031122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:34.049789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:34.056937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:34.076924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 821/1646] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:33 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:34.109237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 826/1647] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:33 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:34.115102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:34.274296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:34.276583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:34.359603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f79341-39bf-42f3-ab79-2665ec0429a4 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:34.388927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:34.389930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:34.390445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:34.390899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:34.391919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:34.398948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:34.498688 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862887a-af86-4ff4-8d06-bd98f5ad15ab None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:34.523537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:34.525023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:34.531421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:34.567918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] PATH_INFO: `/v3/users/8e5e1225ae9f476181466c8b2b0cd998` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:34.567918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5e1225ae9f476181466c8b2b0cd998)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:34.567918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:34.699423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 822/1648] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:34 2021] POST /identity/v3/projects => generated 387 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:34.699423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:34.904260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681098f1-ddfc-42f8-b4ba-49549df8ae1e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:34.935547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:34.936522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:34.936959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:34.937390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:34.938242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:34.940447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:35.324456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 823/1649] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:34 2021] POST /identity/v3/users => generated 300 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:35.328454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:35.354144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46620d90-19bb-4ff1-9c12-bd090de0a0d8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:35.370638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:35.370638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:35.370638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:35.370638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:35.371327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:35.371327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:35.395076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 824/1650] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:35 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:35.396109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:35.398863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:35.413699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac5e6a-ebe8-4fb9-9b38-fc839ba572b7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:35.420179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:35.421226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:35.421808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:35.422145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] PATH_INFO: `/v3/projects/eb3c35249af94c46b9f113607421db94` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:35.423914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3c35249af94c46b9f113607421db94)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:35.426259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:35.504112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5e1225ae9f476181466c8b2b0cd998'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.504112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5e1225ae9f476181466c8b2b0cd998'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.614255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3c35249af94c46b9f113607421db94', 'request_id': 'req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.620905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5e1225ae9f476181466c8b2b0cd998'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.621954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5e1225ae9f476181466c8b2b0cd998'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.628832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3c35249af94c46b9f113607421db94', 'request_id': 'req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.643023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5e1225ae9f476181466c8b2b0cd998'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.667427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 827/1651] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:34 2021] DELETE /identity/v3/users/8e5e1225ae9f476181466c8b2b0cd998 => generated 0 bytes in 1393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:35.670777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:35.671526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:35.792957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d6e2d-1a5d-4fdd-ba45-87ca74f9760f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:35.814539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3c35249af94c46b9f113607421db94', 'request_id': 'req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.829730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e8ecb-5531-41ab-80f8-813af46d3e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:35.832131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] The token cache is being invalidate because project eb3c35249af94c46b9f113607421db94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:35.832617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.839025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e2dcffe2-ac6c-4b3b-9857-7d9f25fefa6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:35.839985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e8ecb-5531-41ab-80f8-813af46d3e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:35.839985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e8ecb-5531-41ab-80f8-813af46d3e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:35.842344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e8ecb-5531-41ab-80f8-813af46d3e9a admin admin] PATH_INFO: `/v3/projects/2331b209fe514fa0bf886d1b49e691f2/users/ed1eff12f8a8407197cd87df6d385afc/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:35.846177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 825/1652] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:35 2021] DELETE /identity/v3/projects/eb3c35249af94c46b9f113607421db94 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:35.848868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2a32-12eb-467c-a118-e85ddeabef26 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:35.870373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2a32-12eb-467c-a118-e85ddeabef26 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:35.871186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2a32-12eb-467c-a118-e85ddeabef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:35.888982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e8ecb-5531-41ab-80f8-813af46d3e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2331b209fe514fa0bf886d1b49e691f2, user_id=ed1eff12f8a8407197cd87df6d385afc, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:35.898123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e8ecb-5531-41ab-80f8-813af46d3e9a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:35.924594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e13c2a32-12eb-467c-a118-e85ddeabef26 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:35.926044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e13c2a32-12eb-467c-a118-e85ddeabef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:35.953916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 826/1653] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:35.953916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:35.953916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:35.953916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:35.984173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:35.984173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.002832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 827/1654] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:36.003678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.007185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.015686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 828/1655] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:35 2021] PUT /identity/v3/projects/2331b209fe514fa0bf886d1b49e691f2/users/ed1eff12f8a8407197cd87df6d385afc/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:36.017012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.017428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.017719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.053155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:36.055267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.123613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935865d-588f-404a-bc56-98d2a64f9b7e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:36.219596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 829/1656] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:36.219596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.221695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.240909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:36.241954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.242174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.242459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.260870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdd155-c36f-4faa-888e-b4efef2762f3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:36.269978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:36.277160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:36.292240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:36.293423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.293751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.294235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.296488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:36.300885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:36.310224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 828/1657] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:36.313821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.330190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 830/1658] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:36.333262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.341446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920092-9916-4d77-b487-7f8421eabd61 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:36.352829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:36.353740 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.354185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.354656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.355694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:36.356181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:36.358392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ede89-daa8-4910-af63-89b031dc1d59 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:36.359496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d4bbd-958d-4e57-b3ea-dc82fe3b11fe admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:36.374395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076644b-4f62-48df-9737-b8e1c113c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:36.375629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076644b-4f62-48df-9737-b8e1c113c6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.377405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076644b-4f62-48df-9737-b8e1c113c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.377405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076644b-4f62-48df-9737-b8e1c113c6b5 admin admin] PATH_INFO: `/v3/projects/2331b209fe514fa0bf886d1b49e691f2/users/ed1eff12f8a8407197cd87df6d385afc/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.383915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076644b-4f62-48df-9737-b8e1c113c6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2331b209fe514fa0bf886d1b49e691f2, user_id=ed1eff12f8a8407197cd87df6d385afc, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:36.389952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076644b-4f62-48df-9737-b8e1c113c6b5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:36.396761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 829/1659] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:36.399923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62470741-79b6-4d4e-89e1-f5f1d274f08f None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.400491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62470741-79b6-4d4e-89e1-f5f1d274f08f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.400920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62470741-79b6-4d4e-89e1-f5f1d274f08f None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.407240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 830/1660] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:03:36 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:03:36.408339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62470741-79b6-4d4e-89e1-f5f1d274f08f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.445287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 831/1661] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:36 2021] PUT /identity/v3/projects/2331b209fe514fa0bf886d1b49e691f2/users/ed1eff12f8a8407197cd87df6d385afc/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:36.447560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5724-6958-4dba-a0cc-55d7c588a426 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.447915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5724-6958-4dba-a0cc-55d7c588a426 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.448277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5724-6958-4dba-a0cc-55d7c588a426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.496019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b47b5724-6958-4dba-a0cc-55d7c588a426 None None] MFA Rules not processed for user `ed1eff12f8a8407197cd87df6d385afc`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:36.497411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b47b5724-6958-4dba-a0cc-55d7c588a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.605350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62470741-79b6-4d4e-89e1-f5f1d274f08f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:36.605623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 832/1662] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:36 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:36.605623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.605623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.613277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:36.614153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:36.614539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:36.614869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.618524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:36.623682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:36.630393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:36.684067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:36.684938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.758858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 831/1663] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:36 2021] POST /identity/v3/projects => generated 373 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:36.768644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.774872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:36.841942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 833/1664] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:03:36 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:36.842872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:36.861280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4988ce5-c84c-4cfe-a575-86b88c2c3d23 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.008456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59850d01-dfe6-4517-9b4a-82ac0fb30151 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.020183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.021860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.024437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.027607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.031615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.033991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.036842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.040884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.040884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.053216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.201831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.206579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.225404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 834/1665] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:36 2021] POST /identity/v3/users => generated 287 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:37.229742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:37.241120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 832/1666] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:36 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:37.268167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c091-fc39-4552-959c-52982cf40fec admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.291645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:37.300097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.300940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.302096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.303422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.305798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.314544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.333452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16f81c-1730-49c5-9b95-609a1f7ee90d service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.339301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 835/1667] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:37.341358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:37.372697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.376368 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.379642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.387102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] PATH_INFO: `/v3/users/f8e27c355e2543a58b07053ee7c841e9` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.400288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e27c355e2543a58b07053ee7c841e9)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.413923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.416090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb6868-0145-468c-b159-475764d96317 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.428581 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.430694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.431213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.431643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.432916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.435285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.456859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 836/1668] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:37 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:37.462300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:37.477883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb4373-429b-4363-913d-d66b1418721a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.488631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.488631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.488631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.488631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] PATH_INFO: `/v3/projects/8f4f7c14aa634803adcec5ccd3ff4d7d/users/67554677ca9b4d64bf41f2391fc84542/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.512635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4f7c14aa634803adcec5ccd3ff4d7d, user_id=67554677ca9b4d64bf41f2391fc84542, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.521591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.671067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 837/1669] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:37 2021] PUT /identity/v3/projects/8f4f7c14aa634803adcec5ccd3ff4d7d/users/67554677ca9b4d64bf41f2391fc84542/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:37.674784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:37.692375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:37.784433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e27c355e2543a58b07053ee7c841e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:37.857684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1079a-1da4-4478-a221-e089b94dddd6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:37.864720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c4fdd-8577-493d-a74d-fddcb693d073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:37.866178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4fdd-8577-493d-a74d-fddcb693d073 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.866748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4fdd-8577-493d-a74d-fddcb693d073 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.867193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c4fdd-8577-493d-a74d-fddcb693d073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.883232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c4fdd-8577-493d-a74d-fddcb693d073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:37.885697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c4fdd-8577-493d-a74d-fddcb693d073 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:37.914131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 838/1670] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:37.917930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e27c355e2543a58b07053ee7c841e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:37.931240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.932334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.938883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:37.948184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e27c355e2543a58b07053ee7c841e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:37.950546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e27c355e2543a58b07053ee7c841e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:37.962268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd19a96f-223d-4559-9a38-a291208398a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e27c355e2543a58b07053ee7c841e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:37.979961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 833/1671] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:37 2021] DELETE /identity/v3/users/f8e27c355e2543a58b07053ee7c841e9 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:37.984870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:37.985049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:37.985251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:38.011433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] MFA Rules not processed for user `67554677ca9b4d64bf41f2391fc84542`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:38.014018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:38.026329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:38.027691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:38.131115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 834/1672] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:38.192269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:38.200394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:38.235034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 839/1673] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:37 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:38.252662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:38.255407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:38.340843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb4b33-67f4-4d3c-81a7-7260587d37ec None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:38.347116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eaccd-d974-4bdb-87c8-28216467d5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:38.349013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eaccd-d974-4bdb-87c8-28216467d5be service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:38.352442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eaccd-d974-4bdb-87c8-28216467d5be service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:38.353212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eaccd-d974-4bdb-87c8-28216467d5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:38.375452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eaccd-d974-4bdb-87c8-28216467d5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:38.378733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eaccd-d974-4bdb-87c8-28216467d5be service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:38.417275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 835/1674] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:38.420454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195b82e-b5ac-445c-a71f-f932a561b5e3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:38.439747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:38.443076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:38.443076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:38.443076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:38.455443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:38.458035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:38.471219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 840/1675] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:38 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:38.584364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e476c44-389e-408b-a9e9-b4bc8065b445 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:38.586346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e476c44-389e-408b-a9e9-b4bc8065b445 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:38.587443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e476c44-389e-408b-a9e9-b4bc8065b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:38.634357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6e476c44-389e-408b-a9e9-b4bc8065b445 None None] MFA Rules not processed for user `6463ded3d09e4dbd908f0d03b20e0555`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:38.695374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6e476c44-389e-408b-a9e9-b4bc8065b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:38.854550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 836/1676] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:38 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:39.339036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:39.390612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:39.390612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f95c8-afe3-4a8e-a61f-2e9ff99a7444 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:39.391746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:39.392981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:39.393414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:39.395146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] PATH_INFO: `/v3/projects/b46f734eca6b4612aa25cae21f225e80` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:39.398321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46f734eca6b4612aa25cae21f225e80)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:39.406115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:40.027248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46f734eca6b4612aa25cae21f225e80', 'request_id': 'req-a997b6b6-0f26-41cc-969d-7c40c01a07ec'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:40.192079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd3de-b369-4753-8116-9227a8ac0926 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:40.192737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd3de-b369-4753-8116-9227a8ac0926 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:40.192737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd3de-b369-4753-8116-9227a8ac0926 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:40.202407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 837/1677] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:03:40 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:03:40.230251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ecbb-0dda-4344-86f3-07d8505d2f8b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:40.230551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ecbb-0dda-4344-86f3-07d8505d2f8b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:40.230847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ecbb-0dda-4344-86f3-07d8505d2f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:40.261202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8e27ecbb-0dda-4344-86f3-07d8505d2f8b None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:40.272118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8e27ecbb-0dda-4344-86f3-07d8505d2f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:40.300356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46f734eca6b4612aa25cae21f225e80', 'request_id': 'req-a997b6b6-0f26-41cc-969d-7c40c01a07ec'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:40.312759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46f734eca6b4612aa25cae21f225e80', 'request_id': 'req-a997b6b6-0f26-41cc-969d-7c40c01a07ec'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:40.353104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] The token cache is being invalidate because project b46f734eca6b4612aa25cae21f225e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:40.354777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:40.355893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a997b6b6-0f26-41cc-969d-7c40c01a07ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:40.360641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 841/1678] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:39 2021] DELETE /identity/v3/projects/b46f734eca6b4612aa25cae21f225e80 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:40.368691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:40.369412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:40.369979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:40.410457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 838/1679] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:03:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:40.428678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:40.430299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:40.624934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 842/1680] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:40.638552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:40.638865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:40.640130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:40.674275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:40.677303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:40.758890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:40.760176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:40.761964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4b27c-32bb-4cf1-89ec-3e4fb6a75fcb None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:40.784895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:40.790325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:40.790325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:40.790325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:40.825390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:40.830452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:40.837152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 839/1681] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:40.837533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:40.865149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123517-909f-4b26-88dc-cd2caf06170c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:40.866090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 843/1682] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:40.911462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:40.911959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:40.912241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:40.913196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:40.914034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:40.914377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:40.929568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:40.986602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 840/1683] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:03:40.988558 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:41.020327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd317f-dbab-4759-9a96-c31a7e057c46 service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:41.024402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:41.029517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:41.036148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:41.036148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:41.036148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:41.036148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:41.036515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:41.036515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:41.060287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9032-a34f-4b11-ac8d-46f6d2d3b6dd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:41.071660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:41.074075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:41.074075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:41.074075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] PATH_INFO: `/v3/users/f04f8026377e4462b8341035eefd8d5a` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:41.075653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04f8026377e4462b8341035eefd8d5a)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:41.078031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:41.491134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 844/1684] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:40 2021] POST /identity/v3/projects => generated 405 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:41.494299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:41.498108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:41.603886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04f8026377e4462b8341035eefd8d5a'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:41.629637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e29c0c-40b4-4012-8ea8-c3f2038b7ba7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:41.642620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:41.643932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:41.644370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:41.644868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] PATH_INFO: `/v3/projects/beb00cc1b2394cb4b26c6c4c7e1d3983` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:41.646676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb00cc1b2394cb4b26c6c4c7e1d3983)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:41.649422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:41.739496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04f8026377e4462b8341035eefd8d5a'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:41.777183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04f8026377e4462b8341035eefd8d5a'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:41.778283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04f8026377e4462b8341035eefd8d5a'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:41.788536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04f8026377e4462b8341035eefd8d5a'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:41.801133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 841/1685] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:41 2021] DELETE /identity/v3/users/f04f8026377e4462b8341035eefd8d5a => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:41.801967 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:41.804155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:41.890813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb00cc1b2394cb4b26c6c4c7e1d3983', 'request_id': 'req-2353c956-9ff4-43a4-88b6-8733b49f248e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:41.923168 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde8743-65e3-4a02-a8e1-9ed7d8a4febe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:42.031876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:42.033087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.033523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.033956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.034899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:42.037092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:42.141299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb00cc1b2394cb4b26c6c4c7e1d3983', 'request_id': 'req-2353c956-9ff4-43a4-88b6-8733b49f248e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:42.153046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb00cc1b2394cb4b26c6c4c7e1d3983', 'request_id': 'req-2353c956-9ff4-43a4-88b6-8733b49f248e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:42.174752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] The token cache is being invalidate because project beb00cc1b2394cb4b26c6c4c7e1d3983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:42.174752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:42.174752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2353c956-9ff4-43a4-88b6-8733b49f248e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:42.183543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 845/1686] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:41 2021] DELETE /identity/v3/projects/beb00cc1b2394cb4b26c6c4c7e1d3983 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:42.187074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.187717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.188648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.202497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 842/1687] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:41 2021] POST /identity/v3/users => generated 303 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:42.214814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:42.214814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:42.221414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42ea2d-f447-4808-8c9b-a3591e04f8b5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:42.228416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:42.229766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.230270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.230838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] PATH_INFO: `/v3/users/ed1eff12f8a8407197cd87df6d385afc` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.232651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1eff12f8a8407197cd87df6d385afc)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:42.235488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:42.247515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:42.251002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:42.290471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 846/1688] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:42.290471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:42.298861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:42.319113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b8ced-78ad-4494-86d1-6c7a4b990640 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:42.324743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:42.329341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.329341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.329341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.329341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:42.329341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:42.344839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 847/1689] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:42 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:42.345828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:42.347597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:42.439706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61ea45-c151-4dd1-b66d-f37ac1c159a2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:42.444165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:42.445013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.445302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.445584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.455780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:42.457260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:42.471850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 848/1690] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:42.489814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:42.489814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2afc1-5c2d-46da-957d-133d1e5a8367 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:42.489814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:42.490402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.490719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.490998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.491738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:42.493799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:42.510388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 849/1691] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:42.514784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:42.526529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573811e8-b3d2-4ca6-b551-8afd6e3c08cf admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:42.532278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225d9e9-cd6a-43c4-a78b-c7fe81fbc460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:42.533421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d9e9-cd6a-43c4-a78b-c7fe81fbc460 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.533666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d9e9-cd6a-43c4-a78b-c7fe81fbc460 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.533935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225d9e9-cd6a-43c4-a78b-c7fe81fbc460 admin admin] PATH_INFO: `/v3/projects/81f29ce9ad3c4822805ac42725527cdb/users/126b46ea5d3841c2817a54e5cbeb70e7/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.551849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225d9e9-cd6a-43c4-a78b-c7fe81fbc460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f29ce9ad3c4822805ac42725527cdb, user_id=126b46ea5d3841c2817a54e5cbeb70e7, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:42.554887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225d9e9-cd6a-43c4-a78b-c7fe81fbc460 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:42.590140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1eff12f8a8407197cd87df6d385afc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:42.750951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 850/1692] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:42 2021] PUT /identity/v3/projects/81f29ce9ad3c4822805ac42725527cdb/users/126b46ea5d3841c2817a54e5cbeb70e7/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:42.777545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45a88-26fe-4783-9754-510a576f706c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:42.777832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45a88-26fe-4783-9754-510a576f706c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:42.778134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45a88-26fe-4783-9754-510a576f706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:42.801187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-06a45a88-26fe-4783-9754-510a576f706c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:42.802418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-06a45a88-26fe-4783-9754-510a576f706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:42.934145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 851/1693] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:42.951059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45a88-26fe-4783-9754-510a576f706c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:43.037120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1eff12f8a8407197cd87df6d385afc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:43.064101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1eff12f8a8407197cd87df6d385afc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:43.064856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1eff12f8a8407197cd87df6d385afc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:43.065578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1eff12f8a8407197cd87df6d385afc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:43.067448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45a88-26fe-4783-9754-510a576f706c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:43.086613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:43.086613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:43.086613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:43.086613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:43.091549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 843/1694] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:42 2021] DELETE /identity/v3/users/ed1eff12f8a8407197cd87df6d385afc => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:43.103311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:43.144239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:43.147258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:43.179383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 852/1695] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:43.579190 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:43.579190 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:43.710328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4ee80-1899-4574-9932-ab3d72caf21a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:43.718586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:43.719873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:43.720870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:43.721330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] PATH_INFO: `/v3/projects/e703e80507d54e979104ab9b8ddc72b3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:43.724682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e703e80507d54e979104ab9b8ddc72b3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:43.731886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:43.907881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:43.909760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:43.928671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e703e80507d54e979104ab9b8ddc72b3', 'request_id': 'req-c1859720-68c4-40eb-88ec-a5460f9de148'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:43.933625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623861e-eca5-4e5f-a0c1-a6a22cfdb3cd service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:43.940334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e703e80507d54e979104ab9b8ddc72b3', 'request_id': 'req-c1859720-68c4-40eb-88ec-a5460f9de148'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.054774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.058668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.058668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.058668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] PATH_INFO: `/v3/projects/2331b209fe514fa0bf886d1b49e691f2` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.060265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2331b209fe514fa0bf886d1b49e691f2)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.062976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.077004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e703e80507d54e979104ab9b8ddc72b3', 'request_id': 'req-c1859720-68c4-40eb-88ec-a5460f9de148'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.142225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] The token cache is being invalidate because project e703e80507d54e979104ab9b8ddc72b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:44.142225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.142225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c1859720-68c4-40eb-88ec-a5460f9de148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.143242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 844/1696] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:43 2021] DELETE /identity/v3/projects/e703e80507d54e979104ab9b8ddc72b3 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:44.149318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6dd0-d543-45fe-8982-402f51377e53 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.149658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6dd0-d543-45fe-8982-402f51377e53 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.149934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6dd0-d543-45fe-8982-402f51377e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.200852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-304a6dd0-d543-45fe-8982-402f51377e53 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:44.202254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-304a6dd0-d543-45fe-8982-402f51377e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:44.212167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 845/1697] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:44.231311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.231656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.232024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.259230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:44.260474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:44.269611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 846/1698] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:44.275211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.288285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c217a-5591-4eea-b4c7-e672fd4f35c5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.293498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.294681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.295054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.295542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.296507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:44.296886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.299065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.313025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 847/1699] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:03:44.320501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.331745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc3d03-4962-4d38-b679-56a2f7bc0394 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.337524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.338136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.338426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.338826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.339522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.341429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.408992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2331b209fe514fa0bf886d1b49e691f2', 'request_id': 'req-e599aa4c-a8f7-4d95-9ab6-929021f5e994'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.488701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2331b209fe514fa0bf886d1b49e691f2', 'request_id': 'req-e599aa4c-a8f7-4d95-9ab6-929021f5e994'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.495496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2331b209fe514fa0bf886d1b49e691f2', 'request_id': 'req-e599aa4c-a8f7-4d95-9ab6-929021f5e994'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.500901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 848/1700] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:44.502880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.508784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] The token cache is being invalidate because project 2331b209fe514fa0bf886d1b49e691f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:44.509089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.510122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e599aa4c-a8f7-4d95-9ab6-929021f5e994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:44.516359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 853/1701] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:43 2021] DELETE /identity/v3/projects/2331b209fe514fa0bf886d1b49e691f2 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:44.517999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d992a1-d6ff-4699-95cd-f5712306dd25 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.518486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d992a1-d6ff-4699-95cd-f5712306dd25 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.518931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d992a1-d6ff-4699-95cd-f5712306dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.553797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c5d992a1-d6ff-4699-95cd-f5712306dd25 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:44.553797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c5d992a1-d6ff-4699-95cd-f5712306dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:44.595126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3678c6-19a1-48b5-aaed-dcbc455fd9a2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.601296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.602337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.602663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.603334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.604042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.606204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.658866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 854/1702] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:44.665308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.667139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.667575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.725861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 849/1703] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:44.731779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.734761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:44.738105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:44.739370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:44.748838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 855/1704] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:44.752979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.754221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa6c-49e7-4108-bcf3-df313ff2608e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.763469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22572ed0-ebaa-4190-89f8-4aae6009f267 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.769149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.769843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.770130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.770410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.771212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.773469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.779326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.781475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.781934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.782373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.783483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:44.785714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.786048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.787126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 850/1705] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:44 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:44.792113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.807760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36b385-489f-403a-8e44-407eca742256 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.811632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 856/1706] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:44.817826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.818265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.819974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.820157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.820918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.821820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.823725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.842177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 851/1707] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:44 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:44.848142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a843b-9b80-4f84-ad96-c406b45da789 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.849442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:44.858878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.860061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.860577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.861092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.862450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.863960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d649fd5-6ab1-459a-9625-2387bfd57b04 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:44.868318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.871027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe1fad-0003-4d59-b363-957b80f7a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:44.872282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1fad-0003-4d59-b363-957b80f7a8af admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:44.872778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1fad-0003-4d59-b363-957b80f7a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:44.873370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1fad-0003-4d59-b363-957b80f7a8af admin admin] PATH_INFO: `/v3/projects/722f920c2a4345478e740bdb9cded2d7/users/8abaa6dc2d184dec863194ed264f1326/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:44.914700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1fad-0003-4d59-b363-957b80f7a8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f920c2a4345478e740bdb9cded2d7, user_id=8abaa6dc2d184dec863194ed264f1326, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:44.917435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe1fad-0003-4d59-b363-957b80f7a8af admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:44.995401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 857/1708] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:44 2021] POST /identity/v3/projects => generated 391 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:45.002928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.064302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 852/1709] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:44 2021] PUT /identity/v3/projects/722f920c2a4345478e740bdb9cded2d7/users/8abaa6dc2d184dec863194ed264f1326/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:45.068288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.069004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.070206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.112011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb039180-c95b-4bae-b040-e125d1d05e23 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.117454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] MFA Rules not processed for user `8abaa6dc2d184dec863194ed264f1326`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:45.118838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:45.203482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.204264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.204623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.205024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.206456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.210693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:45.266314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 853/1710] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:45.267594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.282282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15914c7-7aa5-46dc-82b4-d8446e06a2a4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.288802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.289583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.290729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.290729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.291647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.292919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:45.342239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 858/1711] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/users => generated 296 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:45.343800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.363455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa368bf-f79b-4e11-8ef4-5e572c9badcc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.367480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.369395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.369553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.369845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.370710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.372506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:45.386612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 859/1712] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:45 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:45.389391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.407195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad9935-43cc-446f-8aee-fa3bb49b8630 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.416222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.417156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.417434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.417704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.418611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.420459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:45.433770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 860/1713] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:45 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:45.435059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 854/1714] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:45.438154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.439662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.449637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a00426-2db3-49e1-9a65-e2f6d419297d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.547537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b43f-8290-47c7-b0b6-15bd0d4c18a6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.556143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aabb5-2b27-4ff1-97d4-c0917c48a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.558457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aabb5-2b27-4ff1-97d4-c0917c48a3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.564337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aabb5-2b27-4ff1-97d4-c0917c48a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.564337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aabb5-2b27-4ff1-97d4-c0917c48a3ca admin admin] PATH_INFO: `/v3/projects/0a406a2e6eab4f3db0fb6f3e0f72778a/users/44c60acce0cd4a8f9ef4cd1d478f3a39/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.572168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64d7cc-3997-4eb9-9c2c-5db020c81ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.573437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64d7cc-3997-4eb9-9c2c-5db020c81ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.573961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64d7cc-3997-4eb9-9c2c-5db020c81ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.574420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64d7cc-3997-4eb9-9c2c-5db020c81ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.575634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64d7cc-3997-4eb9-9c2c-5db020c81ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.579227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64d7cc-3997-4eb9-9c2c-5db020c81ed6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:45.593471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aabb5-2b27-4ff1-97d4-c0917c48a3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a406a2e6eab4f3db0fb6f3e0f72778a, user_id=44c60acce0cd4a8f9ef4cd1d478f3a39, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.596269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aabb5-2b27-4ff1-97d4-c0917c48a3ca admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:45.716467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 855/1715] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:45 2021] PUT /identity/v3/projects/0a406a2e6eab4f3db0fb6f3e0f72778a/users/44c60acce0cd4a8f9ef4cd1d478f3a39/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:45.719648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.719648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.719830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.760043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] MFA Rules not processed for user `126b46ea5d3841c2817a54e5cbeb70e7`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:45.761266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:45.800929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 861/1716] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/users => generated 296 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:45.803478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.803855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.804176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.843734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] MFA Rules not processed for user `44c60acce0cd4a8f9ef4cd1d478f3a39`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:45.845392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:45.858905 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 856/1717] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:45.863181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.940913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 862/1718] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:45.940913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:45.940913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:45.979587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da28bd9-c200-49e0-86cb-1bedcf14168f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:45.990823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:45.992547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:45.992846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:45.993153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:45.993858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:45.995654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.008719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 857/1719] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:45 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:46.009575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.022168 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd9dd-0698-4142-a856-2648179947bf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.028748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.029587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.030033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.030431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.031457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.034065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.042150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2204f-71f7-45ff-8e49-457125ab1f9c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.048868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.049576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.049855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.050260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.050931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.052913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.168981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 858/1720] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:46 2021] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:46.170153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.243539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04312-7fc7-4b00-848d-28d916a069ad admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.246077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 863/1721] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:45 2021] POST /identity/v3/projects => generated 403 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:46.247195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.253762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.253762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.253762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.253762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] PATH_INFO: `/v3/projects/a02b26f1d9b94135a66acb0490bfb199/users/99cc1147a11040e0a06cc3aad2e7f9d9/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.267173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02b26f1d9b94135a66acb0490bfb199, user_id=99cc1147a11040e0a06cc3aad2e7f9d9, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.269889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.314147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f3ad-4e59-4c01-aebd-fe3c76d0ddb7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.320548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.321220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.321622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.321915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.322636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.324572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.411779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 859/1722] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:46 2021] PUT /identity/v3/projects/a02b26f1d9b94135a66acb0490bfb199/users/99cc1147a11040e0a06cc3aad2e7f9d9/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:46.413357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.445177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 864/1723] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:46 2021] POST /identity/v3/users => generated 303 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:46.448469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.472526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd426ae-5688-4616-8e09-0056d6a74398 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.511605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac8f9d-8c6c-4ad0-a418-b33c03cfbfa7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.520457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.522945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.526469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.526469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.526469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.530163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.547056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.547773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.548064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.548347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.549162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.551079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.570974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 865/1724] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:46 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:46.572129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.589237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc1f5-19c0-48e5-b86a-7292fd5fcb02 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.597725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.599072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.600203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.600796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.602767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.605843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.611004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 860/1725] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:46 2021] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:46.611867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.622840 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 866/1726] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:46 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:46.623812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.631656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab119-ba9c-409c-8fce-1d3d84455974 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.634886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0889a-9dc9-4f2a-9f2e-8022da43f4f1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.639403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.640898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.641071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.641071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.641278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.641384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] PATH_INFO: `/v3/projects/a02b26f1d9b94135a66acb0490bfb199/users/99cc1147a11040e0a06cc3aad2e7f9d9/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.641513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.641513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.642121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.643501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02b26f1d9b94135a66acb0490bfb199, user_id=99cc1147a11040e0a06cc3aad2e7f9d9, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.643944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.646306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.660145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 867/1727] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:46 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:46.660818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.672340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d851d-a56e-45e5-95e1-57c70308142d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.675112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 861/1728] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:46 2021] PUT /identity/v3/projects/a02b26f1d9b94135a66acb0490bfb199/users/99cc1147a11040e0a06cc3aad2e7f9d9/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:46.678536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:46.801235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29741-0fc2-4235-897d-a0ff204d6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.801235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29741-0fc2-4235-897d-a0ff204d6e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.801235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29741-0fc2-4235-897d-a0ff204d6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.801235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29741-0fc2-4235-897d-a0ff204d6e25 admin admin] PATH_INFO: `/v3/projects/3e130f69def74021864c1a782ba15046/users/96d2c4116a314dcfbeeb72e902aac290/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.820043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb29741-0fc2-4235-897d-a0ff204d6e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e130f69def74021864c1a782ba15046, user_id=96d2c4116a314dcfbeeb72e902aac290, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.820929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb29741-0fc2-4235-897d-a0ff204d6e25 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.827540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd1ad6-cff5-45a3-a978-5ffe0d619078 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:46.836326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:46.837397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.837804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.838147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] PATH_INFO: `/v3/projects/9d4a98413abe4b5299e6e45ccb0ab046/users/4f21cb411ddd4ba1a2e01339c4734f49/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:46.854907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4a98413abe4b5299e6e45ccb0ab046, user_id=4f21cb411ddd4ba1a2e01339c4734f49, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:46.857756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:46.964147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 868/1729] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:46 2021] PUT /identity/v3/projects/3e130f69def74021864c1a782ba15046/users/96d2c4116a314dcfbeeb72e902aac290/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:46.965404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:46.965785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:46.966160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.010837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 862/1730] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:46 2021] PUT /identity/v3/projects/9d4a98413abe4b5299e6e45ccb0ab046/users/4f21cb411ddd4ba1a2e01339c4734f49/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:47.011826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:47.014160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:47.022476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] MFA Rules not processed for user `99cc1147a11040e0a06cc3aad2e7f9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:47.024324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:47.176232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 869/1731] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:46 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:47.176232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:47.184132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b9914-6aca-4971-8278-ef3fe405f49a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:47.195394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb4d40-5dcc-42dc-80ce-86fd150b26d1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:47.203331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:47.204071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:47.204469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:47.205111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] PATH_INFO: `/v3/users/67554677ca9b4d64bf41f2391fc84542` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.206632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67554677ca9b4d64bf41f2391fc84542)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:47.207116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:47.208890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:47.209298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:47.210081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:47.210602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.213135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:47.215352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:47.233091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 870/1732] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:47.234314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:47.253140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ce76f-e58f-48a3-8f70-815f38c958a1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:47.266647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:47.267392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:47.267683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:47.268914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.268914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:47.272682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:47.290193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 871/1733] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:47.290193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:47.303462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c1b76-b087-4e8f-86e8-7ad2da5af0e6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:47.309334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:47.311031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:47.311790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:47.312271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] PATH_INFO: `/v3/users/8abaa6dc2d184dec863194ed264f1326` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.314013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abaa6dc2d184dec863194ed264f1326)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:47.316470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:47.578200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67554677ca9b4d64bf41f2391fc84542'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.578359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abaa6dc2d184dec863194ed264f1326'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.578359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abaa6dc2d184dec863194ed264f1326'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.712150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67554677ca9b4d64bf41f2391fc84542'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.727565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67554677ca9b4d64bf41f2391fc84542'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.728581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67554677ca9b4d64bf41f2391fc84542'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.729195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67554677ca9b4d64bf41f2391fc84542'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.747758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 863/1734] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:47 2021] DELETE /identity/v3/users/67554677ca9b4d64bf41f2391fc84542 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:47.748779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:47.750342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:47.821612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abaa6dc2d184dec863194ed264f1326'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.823267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abaa6dc2d184dec863194ed264f1326'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.841108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288314f0-cc97-4f5c-b531-0d350c1828a2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:47.848636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38b600-0b71-4159-afe7-ce043113a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:47.852130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abaa6dc2d184dec863194ed264f1326'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:47.852682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b600-0b71-4159-afe7-ce043113a925 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:47.854064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b600-0b71-4159-afe7-ce043113a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:47.855205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b600-0b71-4159-afe7-ce043113a925 admin admin] PATH_INFO: `/v3/projects/3e130f69def74021864c1a782ba15046/users/96d2c4116a314dcfbeeb72e902aac290/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.859164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38b600-0b71-4159-afe7-ce043113a925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e130f69def74021864c1a782ba15046, user_id=96d2c4116a314dcfbeeb72e902aac290, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:47.868102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38b600-0b71-4159-afe7-ce043113a925 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:47.876887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 872/1735] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:47 2021] DELETE /identity/v3/users/8abaa6dc2d184dec863194ed264f1326 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:47.878279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:47.881195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:47.882681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 864/1736] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:47 2021] PUT /identity/v3/projects/3e130f69def74021864c1a782ba15046/users/96d2c4116a314dcfbeeb72e902aac290/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:47.885053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147408c-121a-4408-8926-f064d2c7e698 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:47.885556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147408c-121a-4408-8926-f064d2c7e698 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:47.886063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147408c-121a-4408-8926-f064d2c7e698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:47.908730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-3147408c-121a-4408-8926-f064d2c7e698 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:47.910008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3147408c-121a-4408-8926-f064d2c7e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:47.986113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4daf7-d7c0-4441-ab2a-ed962d99b7df admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:48.026545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 865/1737] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:48.026545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421263fb-f888-48e4-b8aa-64f12cb87a23 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.026545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421263fb-f888-48e4-b8aa-64f12cb87a23 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.028193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421263fb-f888-48e4-b8aa-64f12cb87a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.050513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-421263fb-f888-48e4-b8aa-64f12cb87a23 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:48.052657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-421263fb-f888-48e4-b8aa-64f12cb87a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:48.061941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 866/1738] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:48.063544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.064039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.064323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.083544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:48.085821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.087238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.087696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] PATH_INFO: `/v3/projects/9d4a98413abe4b5299e6e45ccb0ab046/users/4f21cb411ddd4ba1a2e01339c4734f49/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.097152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4a98413abe4b5299e6e45ccb0ab046, user_id=4f21cb411ddd4ba1a2e01339c4734f49, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:48.097152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:48.097379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] MFA Rules not processed for user `96d2c4116a314dcfbeeb72e902aac290`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:48.098081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:48.120347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 873/1739] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:47 2021] PUT /identity/v3/projects/9d4a98413abe4b5299e6e45ccb0ab046/users/4f21cb411ddd4ba1a2e01339c4734f49/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:48.120347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:48.126734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:48.228083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 867/1740] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:48 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:48.232619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:48.232782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70384a7-8476-4d59-a597-7b8ac47cb9d6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:48.237095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:48.237931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.238534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.239398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.344943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97607-819a-4572-b3ec-a56d7f766f1c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:48.348102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:48.349053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:48.350433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.350913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.351198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.351950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:48.363582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:48.365877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:48.377356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 868/1741] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:48.378290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:48.379109 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 874/1742] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:48.380107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:48.459195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e0538-b253-434f-b459-091e4bee7da2 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:48.465536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:48.465536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.465536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.466093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.565351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:48.567155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:48.581115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 869/1743] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:48 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:48.639234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:48.641079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:48.654833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee905f10-fc38-4fb5-8b1e-ab77d9e59b92 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:48.659582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:48.660436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:48.660718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:48.660998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:48.665032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:48.777954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:48.780478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922c505-2e79-4f76-8d3e-13260ff6a548 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:48.791530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 875/1744] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:48 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:49.417877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:49.420499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:49.457458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd912dd7-2747-4ea5-9dd8-2d223fcbc531 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:49.467618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:49.470933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:49.470933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:49.471276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] PATH_INFO: `/v3/projects/8f4f7c14aa634803adcec5ccd3ff4d7d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:49.476124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4f7c14aa634803adcec5ccd3ff4d7d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:49.498794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:49.670623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4f7c14aa634803adcec5ccd3ff4d7d', 'request_id': 'req-ae446174-8fb5-4742-a24f-952e1c522369'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:49.681635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4f7c14aa634803adcec5ccd3ff4d7d', 'request_id': 'req-ae446174-8fb5-4742-a24f-952e1c522369'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:49.766262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4f7c14aa634803adcec5ccd3ff4d7d', 'request_id': 'req-ae446174-8fb5-4742-a24f-952e1c522369'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:49.794826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] The token cache is being invalidate because project 8f4f7c14aa634803adcec5ccd3ff4d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:49.795462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:49.796850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ae446174-8fb5-4742-a24f-952e1c522369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:49.799154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 870/1745] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:49 2021] DELETE /identity/v3/projects/8f4f7c14aa634803adcec5ccd3ff4d7d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:49.807513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:49.808083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:49.808207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:49.846549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:49.847964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:49.981801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 876/1746] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:49.991117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:49.992029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:49.992029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.016492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:50.016965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:50.025848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 871/1747] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:50.030158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.041049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a0743-cd4c-46fd-80e1-44872489561f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.046211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.046915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.047933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.047933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.048188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:50.048502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.050180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.071186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.071308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 877/1748] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:50.071867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:50.074871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.090351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb23fb8-9310-433d-b1e4-191b04113be8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.093387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94319d0-f0d2-442e-aafb-16d608d23406 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.097294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.098297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.098690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.099048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] PATH_INFO: `/v3/projects/722f920c2a4345478e740bdb9cded2d7` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.100952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722f920c2a4345478e740bdb9cded2d7)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.101452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.102388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.102599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.102872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.103245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.104280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.106441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.228671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 878/1749] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:50 2021] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:50.232664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.249863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722f920c2a4345478e740bdb9cded2d7', 'request_id': 'req-20986b9c-c669-4adc-9870-27e9ae3013d0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:50.259443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722f920c2a4345478e740bdb9cded2d7', 'request_id': 'req-20986b9c-c669-4adc-9870-27e9ae3013d0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:50.310777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63b50d-6565-4b3a-a3d6-3766edb06e10 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.316300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.317168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.317638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.318014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.319530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.321857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.358412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722f920c2a4345478e740bdb9cded2d7', 'request_id': 'req-20986b9c-c669-4adc-9870-27e9ae3013d0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:50.376215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] The token cache is being invalidate because project 722f920c2a4345478e740bdb9cded2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:50.376838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:50.379419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:50.386108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 872/1750] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:50 2021] DELETE /identity/v3/projects/722f920c2a4345478e740bdb9cded2d7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:50.392945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.394401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:50.461115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 879/1751] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:50 2021] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:50.465449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.468420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:50.486122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cf988-b407-468e-be4f-811ff7fc8186 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.492360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986b9c-c669-4adc-9870-27e9ae3013d0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.497870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.497870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.497870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.497870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.498259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.498259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.499374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.500580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.500580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.500952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] PATH_INFO: `/v3/users/99cc1147a11040e0a06cc3aad2e7f9d9` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.502356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cc1147a11040e0a06cc3aad2e7f9d9)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.504571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.509239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 880/1752] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:50 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:50.516288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.542446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ead2-afec-4b42-861e-357f9c9c1d06 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.542446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.542446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.542446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.543798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.543798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.545319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.563417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 881/1753] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:50 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:50.564511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.577093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fe379-b010-4e7b-bff5-61b1344eb029 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.583384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21931-b393-4492-a363-7b7e4eb1da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.584637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21931-b393-4492-a363-7b7e4eb1da2a admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.585045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21931-b393-4492-a363-7b7e4eb1da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.585188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21931-b393-4492-a363-7b7e4eb1da2a admin admin] PATH_INFO: `/v3/projects/996e2b5d376a4ad59407679005b3bd53/users/6a18e137c866424fa6e9253025383e3b/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.603194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21931-b393-4492-a363-7b7e4eb1da2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=996e2b5d376a4ad59407679005b3bd53, user_id=6a18e137c866424fa6e9253025383e3b, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.605918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21931-b393-4492-a363-7b7e4eb1da2a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.730805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 882/1754] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:50 2021] PUT /identity/v3/projects/996e2b5d376a4ad59407679005b3bd53/users/6a18e137c866424fa6e9253025383e3b/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:50.742076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.742457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.742966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.770778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] MFA Rules not processed for user `6a18e137c866424fa6e9253025383e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:50.772606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:50.819669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cc1147a11040e0a06cc3aad2e7f9d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:50.856486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 883/1755] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:50 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:50.871378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:50.872850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:50.945436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451936c6-904c-42f9-9e80-31cbf8775da4 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:50.949352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:50.950013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:50.950301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:50.950667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:50.959864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:50.961527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:50.971527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 884/1756] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:50 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:50.981308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cc1147a11040e0a06cc3aad2e7f9d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:51.000932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cc1147a11040e0a06cc3aad2e7f9d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:51.002092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cc1147a11040e0a06cc3aad2e7f9d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:51.003142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06ee3c91-a6c3-4c99-bcfa-b24cb555a94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cc1147a11040e0a06cc3aad2e7f9d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:51.019052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 873/1757] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:50 2021] DELETE /identity/v3/users/99cc1147a11040e0a06cc3aad2e7f9d9 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:51.523084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:51.625113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44d46a-587d-42c8-b9a3-597d2a09a5e2 service glance] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:51.687302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992520f8-3084-429e-87ec-69ddd5597a50 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:51.688882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992520f8-3084-429e-87ec-69ddd5597a50 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:51.689375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992520f8-3084-429e-87ec-69ddd5597a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:51.735811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:51.736616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:51.737067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:51.737356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] PATH_INFO: `/v3/projects/a02b26f1d9b94135a66acb0490bfb199` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:51.739327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02b26f1d9b94135a66acb0490bfb199)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:51.742369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:51.767255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-992520f8-3084-429e-87ec-69ddd5597a50 None None] MFA Rules not processed for user `4f21cb411ddd4ba1a2e01339c4734f49`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:51.769392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-992520f8-3084-429e-87ec-69ddd5597a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:51.888941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 874/1758] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:51 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:52.022262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02b26f1d9b94135a66acb0490bfb199', 'request_id': 'req-34e2ac37-9884-4d64-ab22-c67ba0fd9972'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:52.133164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02b26f1d9b94135a66acb0490bfb199', 'request_id': 'req-34e2ac37-9884-4d64-ab22-c67ba0fd9972'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:52.143047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02b26f1d9b94135a66acb0490bfb199', 'request_id': 'req-34e2ac37-9884-4d64-ab22-c67ba0fd9972'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:52.159849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] The token cache is being invalidate because project a02b26f1d9b94135a66acb0490bfb199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:52.160519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:52.161636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-34e2ac37-9884-4d64-ab22-c67ba0fd9972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:52.165850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 885/1759] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:51 2021] DELETE /identity/v3/projects/a02b26f1d9b94135a66acb0490bfb199 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:52.174209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:52.174209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:52.174209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:52.205084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:52.206285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:52.323410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 875/1760] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:52.331324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:52.331841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:52.332328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:52.367638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:52.368844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:52.383406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 886/1761] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:52.384633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:52.399456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf43c3-61c2-443a-835b-98abd94aebb3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:52.412834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:52.413338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:52.415182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:52.415182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:52.415182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:52.415182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:52.416614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:52.462305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 876/1762] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:52.463483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:52.473877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02045-1057-44fc-9e38-4c5ef1ad4156 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:52.480655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:52.481371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:52.481652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:52.481928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:52.482982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:52.485320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:52.606239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:52.607061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 887/1763] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:52 2021] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:52.618904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e6247-7468-4d4c-88ef-5a5cb957caa3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:52.687665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:52.688620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:52.688620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:52.689011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:52.689867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:52.691814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:52.869792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 877/1764] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:52 2021] POST /identity/v3/users => generated 279 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:52.871056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:52.902489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30ef2-2017-494a-b9b2-9caa7e6570ce admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:52.920182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:52.929182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:52.929522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:52.929756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:52.930527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:52.934527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:52.972514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 888/1765] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:52 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:52.977436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:52.989320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2d397-9eac-4b31-958c-7fbba0a92064 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:52.997425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae248021-cfce-4bf1-9a3c-b7f35ce324ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:52.999598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae248021-cfce-4bf1-9a3c-b7f35ce324ca admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:53.002664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae248021-cfce-4bf1-9a3c-b7f35ce324ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:53.002664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae248021-cfce-4bf1-9a3c-b7f35ce324ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:53.002664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae248021-cfce-4bf1-9a3c-b7f35ce324ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:53.003228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae248021-cfce-4bf1-9a3c-b7f35ce324ca admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:53.041110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 878/1766] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:52 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:53.042381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:53.073589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984df62-eca7-41b5-b549-52f2a3322a76 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:53.090510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:53.093539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:53.093539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:53.093539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] PATH_INFO: `/v3/projects/e7eaf96c3bb240b69d34cc18471c8e85/users/713c10bae54a4c82ae236226c5a0a08f/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:53.120582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7eaf96c3bb240b69d34cc18471c8e85, user_id=713c10bae54a4c82ae236226c5a0a08f, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:53.125197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:53.221049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 889/1767] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:53 2021] PUT /identity/v3/projects/e7eaf96c3bb240b69d34cc18471c8e85/users/713c10bae54a4c82ae236226c5a0a08f/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:53.229018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:53.234849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:53.234849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:53.273357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] MFA Rules not processed for user `713c10bae54a4c82ae236226c5a0a08f`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:53.274950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:53.374639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 879/1768] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:53 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:53.380470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:53.483365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30990dfb-7ec3-4288-8ede-ffecbf85d94c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:53.489059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:53.490360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:53.490781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:53.491183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:53.492032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:53.494882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:53.757193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 890/1769] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:53 2021] POST /identity/v3/projects => generated 357 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:53.759447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:53.777561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9c73-56a6-4ace-8ba5-98489d686a21 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:53.869734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:53.876014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:53.876014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:53.876014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:53.876014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:53.876014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:54.065856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 880/1770] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:53 2021] POST /identity/v3/users => generated 285 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:54.075512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:54.086037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe69e9-0bb9-4066-bc38-10aafbf6f771 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:54.091344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:54.092023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.092319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.092592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.093355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:54.095012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:54.107774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 891/1771] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:54.122473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:54.141117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18dde8-67e9-4251-893e-cf16b11e21c3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:54.151927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:54.151927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.152274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.152500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] PATH_INFO: `/v3/projects/567cac02e44b433f993efd40967f2920/users/fda4d0415c314c0fad2474b5a1660f6c/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.195300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567cac02e44b433f993efd40967f2920, user_id=fda4d0415c314c0fad2474b5a1660f6c, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:54.198216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:54.329589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 881/1772] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:54 2021] PUT /identity/v3/projects/567cac02e44b433f993efd40967f2920/users/fda4d0415c314c0fad2474b5a1660f6c/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:54.334233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:54.352010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cec86-933a-4fcf-82cc-c0a3f0bdf53c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:54.439686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236090c7-05b7-4a18-921b-924d274bd3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:54.440716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236090c7-05b7-4a18-921b-924d274bd3ac admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.441195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236090c7-05b7-4a18-921b-924d274bd3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.441664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236090c7-05b7-4a18-921b-924d274bd3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.442642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236090c7-05b7-4a18-921b-924d274bd3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:54.445463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236090c7-05b7-4a18-921b-924d274bd3ac admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:54.466780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 892/1773] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:54.471092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:54.488733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7209-63fb-4e6b-8214-ac3a09ac5055 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:54.495129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:54.496387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.496906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.497382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] PATH_INFO: `/v3/projects/567cac02e44b433f993efd40967f2920/users/fda4d0415c314c0fad2474b5a1660f6c/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.500102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] RBAC: Authorizing `identity:create_grant(project_id=567cac02e44b433f993efd40967f2920, user_id=fda4d0415c314c0fad2474b5a1660f6c, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:54.506351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:54.526791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 882/1774] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:54 2021] PUT /identity/v3/projects/567cac02e44b433f993efd40967f2920/users/fda4d0415c314c0fad2474b5a1660f6c/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:54.528567 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.528864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.529204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.561610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] MFA Rules not processed for user `fda4d0415c314c0fad2474b5a1660f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:54.562993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:54.643042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 893/1775] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:54 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:54.653753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:54.657032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:54.671757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:54.673264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:54.784588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da306e-d2a8-4533-b6f6-6e87dfad286b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:54.799033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:54.803477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.804871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.805529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.829927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:54.831768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:54.837264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3509e-515b-4662-a28e-47ff53c1da3d None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:54.843761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:54.845329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:54.845329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:54.845513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 883/1776] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:54 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:54.845663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] PATH_INFO: `/v3/users/126b46ea5d3841c2817a54e5cbeb70e7` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:54.847821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126b46ea5d3841c2817a54e5cbeb70e7)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:54.850875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:55.163044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126b46ea5d3841c2817a54e5cbeb70e7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:55.171203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126b46ea5d3841c2817a54e5cbeb70e7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:55.253764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126b46ea5d3841c2817a54e5cbeb70e7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:55.254508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126b46ea5d3841c2817a54e5cbeb70e7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:55.276088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126b46ea5d3841c2817a54e5cbeb70e7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:55.306361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 894/1777] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:54 2021] DELETE /identity/v3/users/126b46ea5d3841c2817a54e5cbeb70e7 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:55.363690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:55.366745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:55.384992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820fa8-206a-4dcf-8ca0-9454722436b1 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:55.457299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:55.458086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:55.458391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:55.458976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:55.460620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:55.524116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:55.529163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:55.539631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 884/1778] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:55 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:03:55.679788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:55.681357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:55.750735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498f2e-472b-4678-9f1b-32a29bfd90d8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:55.756616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:55.759357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:55.759357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:55.759357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] PATH_INFO: `/v3/projects/81f29ce9ad3c4822805ac42725527cdb` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:55.759357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f29ce9ad3c4822805ac42725527cdb)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:55.761225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:56.046322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f29ce9ad3c4822805ac42725527cdb', 'request_id': 'req-8a7307dc-a2ec-4855-a444-0f021683accc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.145572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f29ce9ad3c4822805ac42725527cdb', 'request_id': 'req-8a7307dc-a2ec-4855-a444-0f021683accc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.156116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f29ce9ad3c4822805ac42725527cdb', 'request_id': 'req-8a7307dc-a2ec-4855-a444-0f021683accc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.175434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] The token cache is being invalidate because project 81f29ce9ad3c4822805ac42725527cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:56.176271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.176444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.178827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 895/1779] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:55 2021] DELETE /identity/v3/projects/81f29ce9ad3c4822805ac42725527cdb => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:56.187738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:56.206796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593da8b-a78b-475a-9111-60d821c347bc service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:56.210551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:56.212156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:56.409499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:56.414903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:56.414903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:56.414903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] PATH_INFO: `/v3/users/4f21cb411ddd4ba1a2e01339c4734f49` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:56.416241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f21cb411ddd4ba1a2e01339c4734f49)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:56.416421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7307dc-a2ec-4855-a444-0f021683accc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:56.421192 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:56.440798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:56.440798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:56.440798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:56.440798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] PATH_INFO: `/v3/users/44c60acce0cd4a8f9ef4cd1d478f3a39` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:56.441481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c60acce0cd4a8f9ef4cd1d478f3a39)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:56.443541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:56.748103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c60acce0cd4a8f9ef4cd1d478f3a39'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.749920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c60acce0cd4a8f9ef4cd1d478f3a39'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.752340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f21cb411ddd4ba1a2e01339c4734f49'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.871808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c60acce0cd4a8f9ef4cd1d478f3a39'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.872713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c60acce0cd4a8f9ef4cd1d478f3a39'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.891759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8d0340e0-5589-425e-bd2b-f46fa26ec3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c60acce0cd4a8f9ef4cd1d478f3a39'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.906235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 896/1780] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:56 2021] DELETE /identity/v3/users/44c60acce0cd4a8f9ef4cd1d478f3a39 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:56.913238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62e48-150e-47ce-9cab-c9b6c7057b37 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:56.914004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62e48-150e-47ce-9cab-c9b6c7057b37 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:56.914004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62e48-150e-47ce-9cab-c9b6c7057b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:56.937405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-23e62e48-150e-47ce-9cab-c9b6c7057b37 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:56.938991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-23e62e48-150e-47ce-9cab-c9b6c7057b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:56.973629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f21cb411ddd4ba1a2e01339c4734f49'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.991550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f21cb411ddd4ba1a2e01339c4734f49'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.992288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f21cb411ddd4ba1a2e01339c4734f49'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:56.992901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-dc6d1ed0-f559-4e2f-b023-f3556cac8f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f21cb411ddd4ba1a2e01339c4734f49'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:57.013899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 885/1781] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:56 2021] DELETE /identity/v3/users/4f21cb411ddd4ba1a2e01339c4734f49 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:57.013899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b5dbc-7bfc-4265-a56d-192f2cf3a4d4 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.013899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b5dbc-7bfc-4265-a56d-192f2cf3a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.013899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b5dbc-7bfc-4265-a56d-192f2cf3a4d4 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.023449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 897/1782] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:57.024098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 886/1783] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:03:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:03:57.026135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.026429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.027241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.029469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b5dbc-7bfc-4265-a56d-192f2cf3a4d4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:57.031589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-593b5dbc-7bfc-4265-a56d-192f2cf3a4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:57.046275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:57.047529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:57.105762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b5dbc-7bfc-4265-a56d-192f2cf3a4d4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:57.110176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:57.111341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.115455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.115455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.138429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 898/1784] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:03:57 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:57.166801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:57.168661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:57.183266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927750-db54-4e8a-8adc-3a5cb33b1f51 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:57.189164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0efe-0f23-47b3-988d-2023562b52e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:57.189932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0efe-0f23-47b3-988d-2023562b52e8 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.190284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0efe-0f23-47b3-988d-2023562b52e8 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.190652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0efe-0f23-47b3-988d-2023562b52e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.197008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:57.218678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:57.218835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d0efe-0f23-47b3-988d-2023562b52e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:57.218835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d0efe-0f23-47b3-988d-2023562b52e8 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:57.219021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 887/1785] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:57.219116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 899/1786] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:03:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:03:57.321755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:57.323325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:57.340832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7ad5-107d-4cd4-8e9e-1e641d449782 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:57.350895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:57.352180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.352465 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.352762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] PATH_INFO: `/v3/projects/9d4a98413abe4b5299e6e45ccb0ab046` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.354025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4a98413abe4b5299e6e45ccb0ab046)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:57.364223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:57.502198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4a98413abe4b5299e6e45ccb0ab046', 'request_id': 'req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:57.510078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4a98413abe4b5299e6e45ccb0ab046', 'request_id': 'req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:57.613154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4a98413abe4b5299e6e45ccb0ab046', 'request_id': 'req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:57.627892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] The token cache is being invalidate because project 9d4a98413abe4b5299e6e45ccb0ab046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:57.628385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:57.631102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8d90cd8b-05d6-4b63-a093-6aa125c40d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:57.635821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 888/1787] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:57 2021] DELETE /identity/v3/projects/9d4a98413abe4b5299e6e45ccb0ab046 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:57.640360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.640681 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.640962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.676666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:57.680305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:57.797578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 900/1788] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:57.805859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.806153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.806667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.831400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:57.832722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:57.844053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 889/1789] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:03:57.851727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:57.868201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7c2d-3e5e-43e5-a691-6fe91ef06189 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:57.874680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:57.875841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.876378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.876694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.877881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:03:57.883741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:57.892058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:57.926223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 901/1790] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:03:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:03:57.933892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:57.945561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547f24b-9dcf-4e8c-a695-3aada923ccd1 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:57.951044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:57.951876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:57.953467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:57.953467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:57.953467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:57.955785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.041266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.044212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:58.075211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693abf-b425-4413-a847-58cd21aad186 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.085270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.085270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.085903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.085903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] PATH_INFO: `/v3/projects/0a406a2e6eab4f3db0fb6f3e0f72778a` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.087429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a406a2e6eab4f3db0fb6f3e0f72778a)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.090510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.170385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 890/1791] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:57 2021] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:58.171544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.229208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a406a2e6eab4f3db0fb6f3e0f72778a', 'request_id': 'req-84596537-4c6c-42d9-9397-2a770f62396d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.243450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd3dc-95cb-4ae4-9627-d78936ac32fe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.304454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.305138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.305426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.305706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.306404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.308385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.356669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a406a2e6eab4f3db0fb6f3e0f72778a', 'request_id': 'req-84596537-4c6c-42d9-9397-2a770f62396d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.363753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a406a2e6eab4f3db0fb6f3e0f72778a', 'request_id': 'req-84596537-4c6c-42d9-9397-2a770f62396d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.382036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] The token cache is being invalidate because project 0a406a2e6eab4f3db0fb6f3e0f72778a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:58.382036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.382754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.384438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 902/1792] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:58 2021] DELETE /identity/v3/projects/0a406a2e6eab4f3db0fb6f3e0f72778a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:58.387895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 891/1793] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:58 2021] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:58.388537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.388857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.390921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:58.391040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:58.403722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e608-33ce-449c-ac72-b1de4fd950fb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.403916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84596537-4c6c-42d9-9397-2a770f62396d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.408564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.414902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.415037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.415125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.415216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.415216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] PATH_INFO: `/v3/users/96d2c4116a314dcfbeeb72e902aac290` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.415374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.415374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.415526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d2c4116a314dcfbeeb72e902aac290)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.415611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.415690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.415763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.425988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 892/1794] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:58.429515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.440622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588a862-b207-4075-b5e7-f470d07aa5dd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.451758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.452663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.453073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.453446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.454429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.456096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.468360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 893/1795] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:58 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:58.472968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.484227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81c21-6d24-4601-9a90-3544908bc1fe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.489375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ed171-2243-467a-b595-e2ebf6d6e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.490333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ed171-2243-467a-b595-e2ebf6d6e169 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.490650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ed171-2243-467a-b595-e2ebf6d6e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.491333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ed171-2243-467a-b595-e2ebf6d6e169 admin admin] PATH_INFO: `/v3/projects/20641740056d46a596abd3be5cca892a/users/ce1ac4ee946049c1a42ebeb1a64293ce/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.507827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ed171-2243-467a-b595-e2ebf6d6e169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20641740056d46a596abd3be5cca892a, user_id=ce1ac4ee946049c1a42ebeb1a64293ce, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.511575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ed171-2243-467a-b595-e2ebf6d6e169 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:58.626383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 894/1796] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:58 2021] PUT /identity/v3/projects/20641740056d46a596abd3be5cca892a/users/ce1ac4ee946049c1a42ebeb1a64293ce/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:58.643814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.644032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.644315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.673586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] MFA Rules not processed for user `ce1ac4ee946049c1a42ebeb1a64293ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:58.674855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:58.691305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d2c4116a314dcfbeeb72e902aac290'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.692466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d2c4116a314dcfbeeb72e902aac290'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.758239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 895/1797] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:58 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:03:58.767500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:58.798721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d2c4116a314dcfbeeb72e902aac290'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.800387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d2c4116a314dcfbeeb72e902aac290'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.817460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d2c4116a314dcfbeeb72e902aac290'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:58.840927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 903/1798] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:03:58 2021] DELETE /identity/v3/users/96d2c4116a314dcfbeeb72e902aac290 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:58.854212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e57f7-52c3-48cb-b7c3-96953bc559ad None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:58.956643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:58.956860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:58.957138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:58.957418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:58.958117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:58.960238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.096332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 896/1799] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:03:58 2021] POST /identity/v3/projects => generated 365 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:03:59.097844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:59.100709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:59.124184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ef97-a16c-4e19-9cf4-1862e621f8af admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:59.244784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:59.244784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.244784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.244784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.248184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:59.250487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.404933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 904/1800] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:03:59 2021] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:03:59.405037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:59.414798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45734-c739-4aa4-941b-0b8f3f7007b7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:59.420320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:59.420998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.421285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.421560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.422285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:59.424194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.439569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 897/1801] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:59 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:03:59.448165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:59.458488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b544-3e18-49fe-b041-28f11e245636 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:59.473077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:59.477278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.477278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.477278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] PATH_INFO: `/v3/projects/16dc9335a5c045f59d1eb4b11789f0e9/users/be1a506e4d6747cc81c32669766beb5d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.496818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dc9335a5c045f59d1eb4b11789f0e9, user_id=be1a506e4d6747cc81c32669766beb5d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:59.500284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.514668 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:59.519479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:59.534248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143337-3130-4d0b-89b9-bffd6d847e68 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:59.547894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:59.549139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.549683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.550149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] PATH_INFO: `/v3/projects/3e130f69def74021864c1a782ba15046` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.551942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e130f69def74021864c1a782ba15046)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:59.559551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.663492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 905/1802] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:59 2021] PUT /identity/v3/projects/16dc9335a5c045f59d1eb4b11789f0e9/users/be1a506e4d6747cc81c32669766beb5d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:59.669006 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:59.749882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccf7d-15d8-4e09-a3a0-f2b2c6a6c557 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:59.754527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:59.755300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.755590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.755865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.756753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:59.758468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.774702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 906/1803] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:03:59 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:03:59.778013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:03:59.781735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e130f69def74021864c1a782ba15046', 'request_id': 'req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:59.786878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b681f4-8a2c-40ac-9cc6-b7580bb5451b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:03:59.790756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e130f69def74021864c1a782ba15046', 'request_id': 'req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:59.851875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa383b9c-dac1-45c6-a613-6ce8105a5cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:03:59.852877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa383b9c-dac1-45c6-a613-6ce8105a5cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.853160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa383b9c-dac1-45c6-a613-6ce8105a5cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.853433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa383b9c-dac1-45c6-a613-6ce8105a5cbc admin admin] PATH_INFO: `/v3/projects/16dc9335a5c045f59d1eb4b11789f0e9/users/be1a506e4d6747cc81c32669766beb5d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.855640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa383b9c-dac1-45c6-a613-6ce8105a5cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dc9335a5c045f59d1eb4b11789f0e9, user_id=be1a506e4d6747cc81c32669766beb5d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:03:59.858405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa383b9c-dac1-45c6-a613-6ce8105a5cbc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:03:59.874292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 907/1804] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:03:59 2021] PUT /identity/v3/projects/16dc9335a5c045f59d1eb4b11789f0e9/users/be1a506e4d6747cc81c32669766beb5d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:03:59.885972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.886292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.886604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.900387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e130f69def74021864c1a782ba15046', 'request_id': 'req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:59.928506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] MFA Rules not processed for user `be1a506e4d6747cc81c32669766beb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:59.929415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] The token cache is being invalidate because project 3e130f69def74021864c1a782ba15046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:03:59.929911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:59.930065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:03:59.930529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-50ff48e8-2dc9-4f2d-8dbc-5f824dcdc0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:03:59.933645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 898/1805] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:03:59 2021] DELETE /identity/v3/projects/3e130f69def74021864c1a782ba15046 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:03:59.941446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981314d-bbc9-4daa-b5b0-1d969fe0423a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:03:59.942043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981314d-bbc9-4daa-b5b0-1d969fe0423a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:03:59.942526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981314d-bbc9-4daa-b5b0-1d969fe0423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:03:59.963428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f981314d-bbc9-4daa-b5b0-1d969fe0423a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:03:59.964971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f981314d-bbc9-4daa-b5b0-1d969fe0423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:00.067144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 899/1806] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:00.075258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 908/1807] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:03:59 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:00.076564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.076855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.077142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.086417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.088332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:00.101798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:00.103126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:00.115956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 900/1808] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:00.128884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.139484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e0d6a-d57c-4f40-9911-c26f346c8eba None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.144500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.145197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.145483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.146498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.148010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:00.148325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.150155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.163467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 901/1809] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:04:00.168690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.185064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2cf4-0738-46e9-9e1f-e3c2a3ee7860 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.190145 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a131e-dade-4f1c-ab8a-3cb7fb48444e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.191040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.191772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.192058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.192436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.193331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.195002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.195411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.195654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.195993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.196273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.217292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.218960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.232386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 909/1810] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:00 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:00.298196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 902/1811] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:00 2021] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:00.305124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.317125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aeec33-bce7-41eb-b88f-f2dd0615cbfd service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.383839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.384535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.384824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.385158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.385918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.388158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.520947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 910/1812] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:00 2021] POST /identity/v3/users => generated 304 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:00.524105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.535584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea625e94-15c8-40f9-9444-09e44bd33d2b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.543286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.543973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.544257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.544796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.545528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.553055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.558058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.561334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:00.566524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 903/1813] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:00 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:00.571258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.604805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851c94-2a02-4ecc-b97d-5cf7b44a5cfb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.612768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.613507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.613796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.614077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.614895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.620281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.636665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 904/1814] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:00 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:00.652560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:00.663285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e047f-c710-49c7-b552-81ac8e728ada admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.667192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537398c3-8315-4d1a-a8d1-36c64921a9f4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:00.671365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.671520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:00.672355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.672790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.673124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.673535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.673648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.673992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] PATH_INFO: `/v3/projects/9f99224febac4e3c9e96a2b1d1de94f5/users/9c03fe471d2f4fdcae3bbaa408b51590/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.676023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:00.703005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f99224febac4e3c9e96a2b1d1de94f5, user_id=9c03fe471d2f4fdcae3bbaa408b51590, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.713936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.750520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:00.752159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c5c53-fbfc-4957-8b4a-d22e7f39c459 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:00.767195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 911/1815] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:00 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:00.798627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 905/1816] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:00 2021] PUT /identity/v3/projects/9f99224febac4e3c9e96a2b1d1de94f5/users/9c03fe471d2f4fdcae3bbaa408b51590/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:00.813127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:00.813583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:00.813871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:00.847663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] MFA Rules not processed for user `9c03fe471d2f4fdcae3bbaa408b51590`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:00.848923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:00.926772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 912/1817] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:00 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:00.932143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:01.003599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b74830-504c-44ad-924d-4eed6edde273 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:01.010788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:01.011493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.011779 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.012062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.013066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:01.015103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:01.175906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 906/1818] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:00 2021] POST /identity/v3/projects => generated 409 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:01.177253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:01.189226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2822d2-33bd-4123-b7e3-05b1db5f58bb None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:01.251079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:01.251763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.252061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.252330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.253020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:01.254988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:01.394232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 913/1819] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:01 2021] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:01.399527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:01.423256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a327-2883-4a0a-8f13-835aa01fa63b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:01.433145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:01.434173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.434728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.435391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.436407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:01.438634 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:01.456592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 907/1820] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:01 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:01.463409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:01.478449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87484a-ddae-4a10-9e99-e60f96a02d55 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:01.487686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:01.488626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.488977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.489537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] PATH_INFO: `/v3/projects/d6ff5030e8234c838fbe4f2674df19d8/users/99927e096d374a068419a012676f987e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.525097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ff5030e8234c838fbe4f2674df19d8, user_id=99927e096d374a068419a012676f987e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:01.528497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:01.714111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 914/1821] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:01 2021] PUT /identity/v3/projects/d6ff5030e8234c838fbe4f2674df19d8/users/99927e096d374a068419a012676f987e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:01.716141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:01.739935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0163c0b-d03e-4d8d-a04b-8693afc54a2e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:01.857814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14875d-7594-4709-a024-8011129882ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:01.858975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14875d-7594-4709-a024-8011129882ae admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.859346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14875d-7594-4709-a024-8011129882ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.859786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14875d-7594-4709-a024-8011129882ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.860717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14875d-7594-4709-a024-8011129882ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:01.862601 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14875d-7594-4709-a024-8011129882ae admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:01.875469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 908/1822] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:01 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:01.880190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:01.895212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dffe70-cf82-43e2-a68d-d12245b76fd6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:01.903151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:01.904378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.904763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.905218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] PATH_INFO: `/v3/projects/d6ff5030e8234c838fbe4f2674df19d8/users/99927e096d374a068419a012676f987e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.908229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ff5030e8234c838fbe4f2674df19d8, user_id=99927e096d374a068419a012676f987e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:01.911172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:01.925759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 915/1823] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:01 2021] PUT /identity/v3/projects/d6ff5030e8234c838fbe4f2674df19d8/users/99927e096d374a068419a012676f987e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:01.938145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:01.938620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:01.939038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:01.986030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] MFA Rules not processed for user `99927e096d374a068419a012676f987e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:01.987300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:02.088290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 909/1824] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:01 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:02.099492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:02.173095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41374d31-5207-40ee-9418-7c2dfe542d80 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:02.179099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:02.179808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:02.180091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:02.180365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:02.190964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:02.192658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:02.204307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 916/1825] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:02 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:02.728884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:02.743826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c00d-cb78-46bf-aa69-e9d8755d3fc5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:02.749728 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4f9f1-d694-499b-84ab-e669fdba55f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:02.750412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f9f1-d694-499b-84ab-e669fdba55f6 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:02.752406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f9f1-d694-499b-84ab-e669fdba55f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:02.752406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f9f1-d694-499b-84ab-e669fdba55f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:02.873627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f9f1-d694-499b-84ab-e669fdba55f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:02.875448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f9f1-d694-499b-84ab-e669fdba55f6 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:02.890306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 910/1826] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:02 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:06.234420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:06.236130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:06.334967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62db037-45d0-483f-ad1a-19f8b5fe6a65 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:06.340967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:06.341917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:06.342190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:06.342466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] PATH_INFO: `/v3/users/ce1ac4ee946049c1a42ebeb1a64293ce` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:06.344331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1ac4ee946049c1a42ebeb1a64293ce)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:06.346428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:06.566452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1ac4ee946049c1a42ebeb1a64293ce'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:06.567284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1ac4ee946049c1a42ebeb1a64293ce'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:06.653965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1ac4ee946049c1a42ebeb1a64293ce'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:06.654936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1ac4ee946049c1a42ebeb1a64293ce'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:06.668330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1ac4ee946049c1a42ebeb1a64293ce'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:06.681860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 917/1827] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:06 2021] DELETE /identity/v3/users/ce1ac4ee946049c1a42ebeb1a64293ce => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:06.686473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:06.686999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:06.687115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:06.705491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:06.714778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:06.798014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 911/1828] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:06.809956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:06.811495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:06.879162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ee2a-42bd-4cb3-8513-b441dfa62875 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:06.892160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:06.892809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:06.893154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:06.893436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:06.909879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:06.912235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:06.923583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 918/1829] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:07.535898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:07.538452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:07.557695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7a21e-14a8-4b3f-836a-3a81dca2d142 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:07.563688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:07.564929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:07.565299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:07.573151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] PATH_INFO: `/v3/projects/20641740056d46a596abd3be5cca892a` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:07.573151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20641740056d46a596abd3be5cca892a)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:07.573151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:07.733445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20641740056d46a596abd3be5cca892a', 'request_id': 'req-428d821b-fdb2-49aa-9f12-585e5c99dbc7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:07.740748 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20641740056d46a596abd3be5cca892a', 'request_id': 'req-428d821b-fdb2-49aa-9f12-585e5c99dbc7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:07.819848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20641740056d46a596abd3be5cca892a', 'request_id': 'req-428d821b-fdb2-49aa-9f12-585e5c99dbc7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:07.832353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] The token cache is being invalidate because project 20641740056d46a596abd3be5cca892a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:07.832667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:07.833311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:07.835411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 912/1830] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:07 2021] DELETE /identity/v3/projects/20641740056d46a596abd3be5cca892a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:07.845040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:07.862941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70921bb3-d142-4dce-a631-1e859105b689 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:07.949761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:07.950695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:07.951164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:07.951440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] PATH_INFO: `/v3/users/be1a506e4d6747cc81c32669766beb5d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:07.952821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1a506e4d6747cc81c32669766beb5d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:07.954793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:08.263887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1a506e4d6747cc81c32669766beb5d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:08.264623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1a506e4d6747cc81c32669766beb5d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:08.434213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1a506e4d6747cc81c32669766beb5d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:08.435974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1a506e4d6747cc81c32669766beb5d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:08.450126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fcf1dbae-66dd-4f82-8a08-0c8e8eee9782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1a506e4d6747cc81c32669766beb5d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:08.466687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 919/1831] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:07 2021] DELETE /identity/v3/users/be1a506e4d6747cc81c32669766beb5d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:09.044641 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:09.046236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:09.060488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d821b-fdb2-49aa-9f12-585e5c99dbc7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:09.124148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:09.125026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.125307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.125579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] PATH_INFO: `/v3/projects/16dc9335a5c045f59d1eb4b11789f0e9` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.126894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dc9335a5c045f59d1eb4b11789f0e9)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:09.130332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:09.263672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dc9335a5c045f59d1eb4b11789f0e9', 'request_id': 'req-7705157c-e6fd-4d7d-a1d9-6c003808618e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:09.270655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dc9335a5c045f59d1eb4b11789f0e9', 'request_id': 'req-7705157c-e6fd-4d7d-a1d9-6c003808618e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:09.344987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dc9335a5c045f59d1eb4b11789f0e9', 'request_id': 'req-7705157c-e6fd-4d7d-a1d9-6c003808618e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:09.369824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] The token cache is being invalidate because project 16dc9335a5c045f59d1eb4b11789f0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:09.370653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:09.370836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-7705157c-e6fd-4d7d-a1d9-6c003808618e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:09.376639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 913/1832] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:09 2021] DELETE /identity/v3/projects/16dc9335a5c045f59d1eb4b11789f0e9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:09.378516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.379049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.379155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.400378 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:09.401731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:09.472169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 920/1833] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:09.480947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.481550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.481976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.507456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:09.508682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:09.518871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 914/1834] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:09.522791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:09.534934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894bee0-2159-400c-bf95-236bfe4d63b2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:09.543659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:09.544740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.545117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.545596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.546407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:09.546953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:09.548771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:09.562207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 921/1835] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:04:09.566415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:09.581854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589eb11-905c-4b58-974f-1d9ffbf0f934 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:09.587548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:09.588398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.588744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.589125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.590072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:09.592202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:09.723089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 915/1836] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:09 2021] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:09.728570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:09.763719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe2d9e-fefe-428f-a1c5-9e696192cf95 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:09.830694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:09.831480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.831819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.833397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.833397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:09.835761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:09.940501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 922/1837] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:09 2021] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:09.942066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:09.952712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7281b-9836-4941-9a4d-e72f1282a6e8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:09.958734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:09.959617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:09.960019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:09.960405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:09.961256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:09.962951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:09.977355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 916/1838] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:09.980641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:09.994044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14211b67-c658-4884-85db-7f8da42239a8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:09.999124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9582d9e-8ad4-465b-b9f2-63d0b8f2df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:09.999930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582d9e-8ad4-465b-b9f2-63d0b8f2df0f admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.000305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582d9e-8ad4-465b-b9f2-63d0b8f2df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.000668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582d9e-8ad4-465b-b9f2-63d0b8f2df0f admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.001473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582d9e-8ad4-465b-b9f2-63d0b8f2df0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.003183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582d9e-8ad4-465b-b9f2-63d0b8f2df0f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.013883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 923/1839] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:10.018143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.029410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c144c-253b-45dd-804d-3eeb927aa206 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.036637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.037747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.038290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.038706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] PATH_INFO: `/v3/projects/962e73dbeda2454ba9ff001c21a0018d/users/2d6cef19590242e0bc7b753971aede2d/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.059488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962e73dbeda2454ba9ff001c21a0018d, user_id=2d6cef19590242e0bc7b753971aede2d, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.062267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.169125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 917/1840] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:10 2021] PUT /identity/v3/projects/962e73dbeda2454ba9ff001c21a0018d/users/2d6cef19590242e0bc7b753971aede2d/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:10.179740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.180034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.180307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.209142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] MFA Rules not processed for user `2d6cef19590242e0bc7b753971aede2d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:10.210523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:10.277049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 924/1841] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:10 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:10.282015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.351661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f452-c628-4394-838b-08633de97104 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.356742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.357433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.357724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.358001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.358765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.360741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.455492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 918/1842] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:10 2021] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:10.460414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.471260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02087a-1f6a-4d97-a3a6-2ff557c5ed98 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.541183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.542146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.542602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.543053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.543896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.546281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.686593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 925/1843] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:10 2021] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:10.688521 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.699144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ade39-e172-42c4-8853-ebcb37d1cb41 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.703691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.704344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.704624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.704898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.705614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.707237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.721026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 919/1844] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:10.725843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.736185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cfaf4-c683-438f-9667-297402d09818 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.742604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.743538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.743824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.744106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] PATH_INFO: `/v3/projects/81273f5e61ac444bbb2e0b8e22bb8cc7/users/e1f802e433464f478691a1b3bb6fbce1/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.760252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81273f5e61ac444bbb2e0b8e22bb8cc7, user_id=e1f802e433464f478691a1b3bb6fbce1, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.763912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.826675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 926/1845] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:10 2021] PUT /identity/v3/projects/81273f5e61ac444bbb2e0b8e22bb8cc7/users/e1f802e433464f478691a1b3bb6fbce1/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:10.830699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.840858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661c905-29fd-4405-a743-f5fd33562b0d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.918754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6a9e-ff5b-4ae6-a0a8-ee97930cadfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.919715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6a9e-ff5b-4ae6-a0a8-ee97930cadfd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.920002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6a9e-ff5b-4ae6-a0a8-ee97930cadfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.920281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6a9e-ff5b-4ae6-a0a8-ee97930cadfd admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.921254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6a9e-ff5b-4ae6-a0a8-ee97930cadfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.925962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6a9e-ff5b-4ae6-a0a8-ee97930cadfd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.939673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 920/1846] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:10.945646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:10.957457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79183a-41cf-45e8-854f-4f8686eae7b5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:10.962212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:10.963374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.963583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.963863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] PATH_INFO: `/v3/projects/81273f5e61ac444bbb2e0b8e22bb8cc7/users/e1f802e433464f478691a1b3bb6fbce1/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:10.965918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81273f5e61ac444bbb2e0b8e22bb8cc7, user_id=e1f802e433464f478691a1b3bb6fbce1, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:10.968709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:10.982969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 927/1847] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:10 2021] PUT /identity/v3/projects/81273f5e61ac444bbb2e0b8e22bb8cc7/users/e1f802e433464f478691a1b3bb6fbce1/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:10.995358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:10.995778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:10.996135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:11.026430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] MFA Rules not processed for user `e1f802e433464f478691a1b3bb6fbce1`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:11.027766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:11.104648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 921/1848] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:10 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:11.115767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:11.118278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:11.202754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d772-35ca-41fd-a7e0-824160a7b03b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:11.207210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb563d-f247-4a39-b400-7098e4727f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:11.208508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb563d-f247-4a39-b400-7098e4727f22 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:11.208806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb563d-f247-4a39-b400-7098e4727f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:11.209080 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb563d-f247-4a39-b400-7098e4727f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:11.219255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb563d-f247-4a39-b400-7098e4727f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:11.220738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb563d-f247-4a39-b400-7098e4727f22 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:11.241773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 928/1849] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:11 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:11.363354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:11.427853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30aef-bae2-4793-9703-7c638e169abb None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:11.432639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:11.433517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:11.433804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:11.434089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] PATH_INFO: `/v3/users/2d6cef19590242e0bc7b753971aede2d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:11.435312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6cef19590242e0bc7b753971aede2d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:11.437252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:11.645409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6cef19590242e0bc7b753971aede2d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:11.779038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6cef19590242e0bc7b753971aede2d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:11.794085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6cef19590242e0bc7b753971aede2d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:11.795122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6cef19590242e0bc7b753971aede2d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:11.796184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6cef19590242e0bc7b753971aede2d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:11.811798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 922/1850] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:11 2021] DELETE /identity/v3/users/2d6cef19590242e0bc7b753971aede2d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:11.816373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:11.816917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:11.817994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:11.846259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:11.847517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:11.918475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 929/1851] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:11.934148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:11.934148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:12.000843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf4c56-f884-469e-8139-4d52bc816bf8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:12.004806 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:12.005465 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:12.005741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:12.006058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:12.017206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:12.019988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:12.029848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 923/1852] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:04:12.478406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:12.479962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:12.495272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0b31-00e1-4b15-9a1b-5aa2a449d7fb None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:12.501036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:12.501784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:12.502108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:12.502319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] PATH_INFO: `/v3/projects/962e73dbeda2454ba9ff001c21a0018d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:12.503901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962e73dbeda2454ba9ff001c21a0018d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:12.505964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:12.628265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962e73dbeda2454ba9ff001c21a0018d', 'request_id': 'req-6014d228-4696-40c1-9008-a76964135859'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:12.706011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962e73dbeda2454ba9ff001c21a0018d', 'request_id': 'req-6014d228-4696-40c1-9008-a76964135859'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:12.723749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962e73dbeda2454ba9ff001c21a0018d', 'request_id': 'req-6014d228-4696-40c1-9008-a76964135859'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:12.731238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] The token cache is being invalidate because project 962e73dbeda2454ba9ff001c21a0018d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:12.731605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:12.732299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:12.735154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 930/1853] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:12 2021] DELETE /identity/v3/projects/962e73dbeda2454ba9ff001c21a0018d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:12.741386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:12.753199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa58d63-759b-4509-9a50-60ddb56fbebd service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:12.815470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:12.816349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:12.816633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:12.816907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] PATH_INFO: `/v3/users/e1f802e433464f478691a1b3bb6fbce1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:12.818511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f802e433464f478691a1b3bb6fbce1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:12.820468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:13.004315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f802e433464f478691a1b3bb6fbce1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.110768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f802e433464f478691a1b3bb6fbce1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.124198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f802e433464f478691a1b3bb6fbce1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.124899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f802e433464f478691a1b3bb6fbce1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.125545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-eee7c16b-d00f-4d33-a19f-1094b8f00281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f802e433464f478691a1b3bb6fbce1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.138137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 924/1854] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:12 2021] DELETE /identity/v3/users/e1f802e433464f478691a1b3bb6fbce1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:13.606305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:13.610213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:13.624363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d228-4696-40c1-9008-a76964135859 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:13.688574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:13.689564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:13.689849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:13.690121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] PATH_INFO: `/v3/projects/81273f5e61ac444bbb2e0b8e22bb8cc7` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:13.691346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81273f5e61ac444bbb2e0b8e22bb8cc7)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:13.694051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:13.856934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81273f5e61ac444bbb2e0b8e22bb8cc7', 'request_id': 'req-3eb87b82-81f6-41b6-9461-d9a6601e29a1'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.933611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81273f5e61ac444bbb2e0b8e22bb8cc7', 'request_id': 'req-3eb87b82-81f6-41b6-9461-d9a6601e29a1'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.939544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81273f5e61ac444bbb2e0b8e22bb8cc7', 'request_id': 'req-3eb87b82-81f6-41b6-9461-d9a6601e29a1'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.955161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] The token cache is being invalidate because project 81273f5e61ac444bbb2e0b8e22bb8cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:13.955673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.956903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3eb87b82-81f6-41b6-9461-d9a6601e29a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:13.960307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 931/1855] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:13 2021] DELETE /identity/v3/projects/81273f5e61ac444bbb2e0b8e22bb8cc7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:13.966446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:13.966956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:13.967068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:13.987964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:13.989381 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:14.077127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 925/1856] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:14.088200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.088905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.089289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.113673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:14.116721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:14.135524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 932/1857] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:14.146609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.158844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6f45-30d6-44af-8528-cf227e1f4ad2 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.165450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.166944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.167345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.167725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.168871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:14.169683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.171561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:14.186766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 926/1858] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:04:14.190430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.202338 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045dfb-d632-45bf-8440-45d5410cbcc8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.207373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.208652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.208936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.209211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.209962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.212169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:14.321266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 933/1859] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:14 2021] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:14.325497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.336939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f74db2-ab6d-44c9-8f13-c3c29182958a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.403171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.409229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.409229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.409229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.409229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.409229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:14.514113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 927/1860] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:14 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:14.518838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.530049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0f55-5746-4781-b056-31643a585977 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.538583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.543193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.543193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.543193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.543193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.543193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:14.555428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 934/1861] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:14.559393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.571328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53f0a6-6d17-4f19-9896-19472ee035df admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.583220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f12da-fc60-4165-ac92-9eae80580702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.584084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f12da-fc60-4165-ac92-9eae80580702 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.584480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f12da-fc60-4165-ac92-9eae80580702 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.584910 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f12da-fc60-4165-ac92-9eae80580702 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.585849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f12da-fc60-4165-ac92-9eae80580702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.587786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f12da-fc60-4165-ac92-9eae80580702 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:14.602011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 928/1862] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:14 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:14.606538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.619912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34868-32eb-481b-ad40-2d96d2d7c20e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.625367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.626489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.626815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.627261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] PATH_INFO: `/v3/projects/c6ccdb9643d54ec9b62e4605153add89/users/6c9c3973e2824418b17ee9f90eda64e5/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.646026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ccdb9643d54ec9b62e4605153add89, user_id=6c9c3973e2824418b17ee9f90eda64e5, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.649710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:14.774322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 935/1863] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:14 2021] PUT /identity/v3/projects/c6ccdb9643d54ec9b62e4605153add89/users/6c9c3973e2824418b17ee9f90eda64e5/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:14.786299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.786619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.786899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.814891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] MFA Rules not processed for user `6c9c3973e2824418b17ee9f90eda64e5`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:14.816124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:14.883194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 929/1864] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:14 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:14.887814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:14.949712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8591d2-a1b3-4182-a609-f849b3705920 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:14.954486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:14.955193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:14.957381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:14.957381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:14.957381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:14.958730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.074770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 936/1865] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:14 2021] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:15.079017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:15.090963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8110-235c-4e76-a3eb-2fa4cad3bbe6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:15.156907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:15.158078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.158605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.159100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.160366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:15.164679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.317727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 930/1866] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:15 2021] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:15.321175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:15.331673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8871d-6cac-4e40-ac1f-40a8703b81c8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:15.337704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:15.338394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.338709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.338989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.339725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:15.341376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.359592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 937/1867] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:15 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:15.363714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:15.375844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f1c5-4383-462c-9a65-1f832e3275a6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:15.381110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:15.382014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.382487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.383086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] PATH_INFO: `/v3/projects/5ed8c530d28549ce933302eda8a5dc80/users/214ff8d6cd4843308dab5e36c4bacf67/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.401969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed8c530d28549ce933302eda8a5dc80, user_id=214ff8d6cd4843308dab5e36c4bacf67, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:15.405081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.553537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 931/1868] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:15 2021] PUT /identity/v3/projects/5ed8c530d28549ce933302eda8a5dc80/users/214ff8d6cd4843308dab5e36c4bacf67/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:15.557568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:15.570551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f870a2a-4d0c-4ace-84e5-449a9cbbe34d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:15.638594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82063e-09b4-4c63-ad26-179789a17105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:15.639306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82063e-09b4-4c63-ad26-179789a17105 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.639600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82063e-09b4-4c63-ad26-179789a17105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.639815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82063e-09b4-4c63-ad26-179789a17105 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.640536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82063e-09b4-4c63-ad26-179789a17105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:15.642149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82063e-09b4-4c63-ad26-179789a17105 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.657457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 938/1869] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:15 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:15.660274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:15.672458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee12c-0e76-40aa-976c-92e4e1f28baf admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:15.679872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:15.681037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.681431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.681790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] PATH_INFO: `/v3/projects/5ed8c530d28549ce933302eda8a5dc80/users/214ff8d6cd4843308dab5e36c4bacf67/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.685415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed8c530d28549ce933302eda8a5dc80, user_id=214ff8d6cd4843308dab5e36c4bacf67, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:15.690538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.704585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 932/1870] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:15 2021] PUT /identity/v3/projects/5ed8c530d28549ce933302eda8a5dc80/users/214ff8d6cd4843308dab5e36c4bacf67/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:15.715646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.715935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.716215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.746991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] MFA Rules not processed for user `214ff8d6cd4843308dab5e36c4bacf67`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:15.748206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:15.818385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 939/1871] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:15 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:15.827968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:15.829638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:15.904484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175bcd1-90a6-4df5-a3b1-23a498bec3c6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:15.908265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4b978-6585-476d-a48b-b4158a05580f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:15.908954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b978-6585-476d-a48b-b4158a05580f service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:15.909296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b978-6585-476d-a48b-b4158a05580f service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:15.909589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b978-6585-476d-a48b-b4158a05580f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:15.919875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4b978-6585-476d-a48b-b4158a05580f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:15.921477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4b978-6585-476d-a48b-b4158a05580f service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:15.934731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 933/1872] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:15 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:17.455705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:17.519194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a75b9-8df8-4d6a-b2ed-ad9df5d09483 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:17.524583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:17.525453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:17.525731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:17.526005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] PATH_INFO: `/v3/users/6c9c3973e2824418b17ee9f90eda64e5` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:17.527518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9c3973e2824418b17ee9f90eda64e5)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:17.529443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:17.851405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9c3973e2824418b17ee9f90eda64e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:17.853579 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9c3973e2824418b17ee9f90eda64e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:17.956497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9c3973e2824418b17ee9f90eda64e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:17.957371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9c3973e2824418b17ee9f90eda64e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:17.970123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9c3973e2824418b17ee9f90eda64e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:17.986308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 940/1873] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:17 2021] DELETE /identity/v3/users/6c9c3973e2824418b17ee9f90eda64e5 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:17.991846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893687f-e928-424e-8467-847f472c47d8 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:17.992346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893687f-e928-424e-8467-847f472c47d8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:17.992483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893687f-e928-424e-8467-847f472c47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:18.018087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5893687f-e928-424e-8467-847f472c47d8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:18.019400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5893687f-e928-424e-8467-847f472c47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:18.086933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 934/1874] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:18.099785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:18.101234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:18.162323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8158c-d2b9-47a1-b250-b2e84081a2cf admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:18.166498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:18.167198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:18.167482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:18.167763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:18.177941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:18.179423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:18.194177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 941/1875] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:18.725527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893687f-e928-424e-8467-847f472c47d8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:18.727048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5893687f-e928-424e-8467-847f472c47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:18.740550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893687f-e928-424e-8467-847f472c47d8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:18.749401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:18.750281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:18.750586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:18.750879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] PATH_INFO: `/v3/projects/c6ccdb9643d54ec9b62e4605153add89` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:18.752102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ccdb9643d54ec9b62e4605153add89)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:18.754014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:18.860396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ccdb9643d54ec9b62e4605153add89', 'request_id': 'req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:18.869116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ccdb9643d54ec9b62e4605153add89', 'request_id': 'req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:18.962513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ccdb9643d54ec9b62e4605153add89', 'request_id': 'req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:18.981499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] The token cache is being invalidate because project c6ccdb9643d54ec9b62e4605153add89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:18.981808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:18.982498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:18.984548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 935/1876] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:18 2021] DELETE /identity/v3/projects/c6ccdb9643d54ec9b62e4605153add89 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:18.990051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:19.011480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81215e7c-4a97-47f6-a203-89112803651c service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:19.093032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:19.093975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:19.094265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:19.094875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] PATH_INFO: `/v3/users/214ff8d6cd4843308dab5e36c4bacf67` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:19.095970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=214ff8d6cd4843308dab5e36c4bacf67)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:19.098037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:19.190796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:19.193960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:19.209765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8e6a5-fe1c-497a-82d4-30d4dc8ecd80 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:19.217125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:19.218437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:19.218955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:19.219242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] PATH_INFO: `/v3/users/9c03fe471d2f4fdcae3bbaa408b51590` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:19.220550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c03fe471d2f4fdcae3bbaa408b51590)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:19.222471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:19.364846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214ff8d6cd4843308dab5e36c4bacf67'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.365601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214ff8d6cd4843308dab5e36c4bacf67'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.441548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c03fe471d2f4fdcae3bbaa408b51590'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.448066 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214ff8d6cd4843308dab5e36c4bacf67'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.448705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214ff8d6cd4843308dab5e36c4bacf67'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.462820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-786d4c2a-a0cc-4dd7-b6e8-aac92af49b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214ff8d6cd4843308dab5e36c4bacf67'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.475720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 942/1877] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:18 2021] DELETE /identity/v3/users/214ff8d6cd4843308dab5e36c4bacf67 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:19.499958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c03fe471d2f4fdcae3bbaa408b51590'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.516065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c03fe471d2f4fdcae3bbaa408b51590'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.517014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c03fe471d2f4fdcae3bbaa408b51590'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.517658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c03fe471d2f4fdcae3bbaa408b51590'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:19.534256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 936/1878] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:19 2021] DELETE /identity/v3/users/9c03fe471d2f4fdcae3bbaa408b51590 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:19.539059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:19.539385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:19.539678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:19.560798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:19.562393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:19.630053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 943/1879] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:19.638792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:19.640227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:19.712950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891e6f-9bbe-434a-8c2a-c5b362bef574 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:19.717247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:19.718046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:19.718421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:19.718714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:19.729759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:19.731384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:19.753658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 937/1880] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:20.040060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.043181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:20.055919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b7b3-1238-4e64-9d32-df3f130b03de None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.086321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.087710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.088115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.088407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] PATH_INFO: `/v3/projects/5ed8c530d28549ce933302eda8a5dc80` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.089698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed8c530d28549ce933302eda8a5dc80)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.091851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:20.209158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed8c530d28549ce933302eda8a5dc80', 'request_id': 'req-7c701e83-00d3-4679-9ae2-2746f0d4a185'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.334164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed8c530d28549ce933302eda8a5dc80', 'request_id': 'req-7c701e83-00d3-4679-9ae2-2746f0d4a185'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.344258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed8c530d28549ce933302eda8a5dc80', 'request_id': 'req-7c701e83-00d3-4679-9ae2-2746f0d4a185'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.360568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] The token cache is being invalidate because project 5ed8c530d28549ce933302eda8a5dc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:20.360927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.361656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.362266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7c701e83-00d3-4679-9ae2-2746f0d4a185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.363926 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 944/1881] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:20 2021] DELETE /identity/v3/projects/5ed8c530d28549ce933302eda8a5dc80 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:20.367159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:20.371019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb5edb-509c-434f-b106-686c6a384a91 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.371321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb5edb-509c-434f-b106-686c6a384a91 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.371632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb5edb-509c-434f-b106-686c6a384a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.395801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-efcb5edb-509c-434f-b106-686c6a384a91 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:20.396075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662544fc-0a31-4a9e-8858-a221b6924311 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.397544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-efcb5edb-509c-434f-b106-686c6a384a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:20.469342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.471096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.471700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.472292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] PATH_INFO: `/v3/projects/9f99224febac4e3c9e96a2b1d1de94f5` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.478758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 945/1882] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:20.480191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f99224febac4e3c9e96a2b1d1de94f5)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.482996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:20.484301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.484601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.484896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.509772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:20.511198 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:20.524467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 946/1883] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:20.525539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.535209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4e6cb-8b8d-46dc-8099-0c71f7ccec51 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.541055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.541731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.546406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.546406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.546406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:20.546406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.546406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:20.558960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 947/1884] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:04:20.563511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.575726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3f627-097b-4599-b77b-2bfe7cde8802 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.581134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.581823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.582110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.585512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.585512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.586214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:20.624169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f99224febac4e3c9e96a2b1d1de94f5', 'request_id': 'req-17e22480-954f-4069-9fe1-b087508a52ab'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.637448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f99224febac4e3c9e96a2b1d1de94f5', 'request_id': 'req-17e22480-954f-4069-9fe1-b087508a52ab'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.702877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 948/1885] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:20 2021] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:20.707507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.725329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f99224febac4e3c9e96a2b1d1de94f5', 'request_id': 'req-17e22480-954f-4069-9fe1-b087508a52ab'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.759500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] The token cache is being invalidate because project 9f99224febac4e3c9e96a2b1d1de94f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:20.760372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.765877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:20.778614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 938/1886] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:20 2021] DELETE /identity/v3/projects/9f99224febac4e3c9e96a2b1d1de94f5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:20.785300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.787805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:20.796787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b54a6-6544-4323-94ce-d1ab4552bdca admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.805770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.808280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.808687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.808972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.809697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.812681 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:20.889267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e22480-954f-4069-9fe1-b087508a52ab admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.896330 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.897332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.898009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.898009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] PATH_INFO: `/v3/users/99927e096d374a068419a012676f987e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.900698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99927e096d374a068419a012676f987e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.902778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:20.951769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 949/1887] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:20 2021] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:20.956327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:20.958163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:20.971866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f92b91-bde2-453b-8ece-7814b483e9fd admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:20.979026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:20.979722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:20.980052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:20.980353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:20.981799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:20.987307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.003730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 950/1888] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:21.004243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.017342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fb06-a710-4118-b722-a1d98f435d78 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.024370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.025187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.025514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.033343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.033343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:21.033343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.046016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 951/1889] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:21.052915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.067390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad88578-d41a-4ce0-9c11-ce064952e95e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.073852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356feae8-1a5b-49b6-84d5-e0949fe8fb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.074830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356feae8-1a5b-49b6-84d5-e0949fe8fb8a admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.075087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356feae8-1a5b-49b6-84d5-e0949fe8fb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.075365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356feae8-1a5b-49b6-84d5-e0949fe8fb8a admin admin] PATH_INFO: `/v3/projects/ff1ef1b3c2864e95a419533fab7faffb/users/d77ffd431d9d4e7aafe19ac0234efc0a/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.092807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356feae8-1a5b-49b6-84d5-e0949fe8fb8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1ef1b3c2864e95a419533fab7faffb, user_id=d77ffd431d9d4e7aafe19ac0234efc0a, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:21.095475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356feae8-1a5b-49b6-84d5-e0949fe8fb8a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.177159 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99927e096d374a068419a012676f987e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:21.208730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 952/1890] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:21 2021] PUT /identity/v3/projects/ff1ef1b3c2864e95a419533fab7faffb/users/d77ffd431d9d4e7aafe19ac0234efc0a/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:21.227140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.227420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.227906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.264082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] MFA Rules not processed for user `d77ffd431d9d4e7aafe19ac0234efc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:21.265321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:21.271195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99927e096d374a068419a012676f987e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:21.289255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99927e096d374a068419a012676f987e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:21.291391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99927e096d374a068419a012676f987e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:21.292660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99927e096d374a068419a012676f987e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:21.323832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 939/1891] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:20 2021] DELETE /identity/v3/users/99927e096d374a068419a012676f987e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:21.357801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 953/1892] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:21.363279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.365516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:21.459463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92def-47da-4d5d-a55f-cb67f6f249eb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.470680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.471708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.471986 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.472425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.473719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:21.476660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.627954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 940/1893] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:21 2021] POST /identity/v3/projects => generated 383 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:21.633074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.714657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ab55-abd9-4dff-9296-f4b5b304e18b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.780234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.780960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.781245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.781521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.782229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:21.784466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.930686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 954/1894] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:21 2021] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:21.930887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.932959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:21.937592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.949142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b9f18-aee4-4de8-b572-b916d00c44e7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.949377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1ed0-426f-49d3-bb56-4d1c050b3181 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.955328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.955831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.958147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.958147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.970421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.971260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.971376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.971376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] PATH_INFO: `/v3/projects/d6ff5030e8234c838fbe4f2674df19d8` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:21.971505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:21.971614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ff5030e8234c838fbe4f2674df19d8)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:21.971745 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.971831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:21.975221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 955/1895] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:21.979307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:21.989538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879501d5-e30c-4b51-903b-d1f26306c0d7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:21.998010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:21.998010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:21.998010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:21.998010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] PATH_INFO: `/v3/projects/4b3cfb2433874983af393c8f29341ae2/users/0e6f013341254ecf99687e382835bff0/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.016886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3cfb2433874983af393c8f29341ae2, user_id=0e6f013341254ecf99687e382835bff0, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.021637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.142372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 956/1896] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:21 2021] PUT /identity/v3/projects/4b3cfb2433874983af393c8f29341ae2/users/0e6f013341254ecf99687e382835bff0/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:22.146954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.159401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ff5030e8234c838fbe4f2674df19d8', 'request_id': 'req-3bce1567-707b-4e14-99af-82aa33b59e55'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:22.168309 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ff5030e8234c838fbe4f2674df19d8', 'request_id': 'req-3bce1567-707b-4e14-99af-82aa33b59e55'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:22.218174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed467d86-cda3-45cc-a396-a96c67c05797 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.275419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.276028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.276168 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ff5030e8234c838fbe4f2674df19d8', 'request_id': 'req-3bce1567-707b-4e14-99af-82aa33b59e55'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:22.276312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.276586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.277317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.278976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.288465 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] The token cache is being invalidate because project d6ff5030e8234c838fbe4f2674df19d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:22.288768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:22.289337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 957/1897] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:22.289501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-3bce1567-707b-4e14-99af-82aa33b59e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:22.291426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 941/1898] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:21 2021] DELETE /identity/v3/projects/d6ff5030e8234c838fbe4f2674df19d8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:22.295104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.297073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:22.300217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782fd4a-0551-40e9-a554-3b38c51729f4 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.300511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782fd4a-0551-40e9-a554-3b38c51729f4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.300795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782fd4a-0551-40e9-a554-3b38c51729f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.310596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab97605-ab86-40c9-b47a-c9f870fba4ab admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.315500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1aefa-2cbb-4bef-a44a-c472cd824179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.316403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1aefa-2cbb-4bef-a44a-c472cd824179 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.316687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1aefa-2cbb-4bef-a44a-c472cd824179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.317507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1aefa-2cbb-4bef-a44a-c472cd824179 admin admin] PATH_INFO: `/v3/projects/4b3cfb2433874983af393c8f29341ae2/users/0e6f013341254ecf99687e382835bff0/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.319725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1aefa-2cbb-4bef-a44a-c472cd824179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3cfb2433874983af393c8f29341ae2, user_id=0e6f013341254ecf99687e382835bff0, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.320709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-1782fd4a-0551-40e9-a554-3b38c51729f4 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:22.321998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1782fd4a-0551-40e9-a554-3b38c51729f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:22.322526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1aefa-2cbb-4bef-a44a-c472cd824179 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.340701 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 942/1899] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:22.340902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 958/1900] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:22 2021] PUT /identity/v3/projects/4b3cfb2433874983af393c8f29341ae2/users/0e6f013341254ecf99687e382835bff0/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:22.342473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.342790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.343071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.358449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.360149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.360149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.366955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:22.368848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:22.399047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] MFA Rules not processed for user `0e6f013341254ecf99687e382835bff0`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:22.400532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:22.454088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 943/1901] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:22.459151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.468359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059ae5-b575-4629-a2da-473e241acc9a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.474316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.475245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.475528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.475803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.476542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:22.476843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.478478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.493229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 959/1902] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:22 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:22.496832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 944/1903] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:04:22.503196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.503584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.505588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:22.521386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365cc0-85e3-4c12-a733-dbe0f197ce96 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.528496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.529137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.529551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.529891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.530632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.532547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.568577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d840f1c-d7be-4738-a61e-7226698f80a4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.573454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.574202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.574536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.574914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.576813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:22.654637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 960/1904] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:22 2021] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:22.656856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.666653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.668617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.683250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 945/1905] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:22 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:04:22.752512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797e77-968e-49c7-a72b-074a8eb4b5ca admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.771975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.771975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.771975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.771975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.774249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.774249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.880763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 961/1906] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:22 2021] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:22.885306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.898343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2640b3-6bc2-4cff-a4d7-99b98d0a160c service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.903669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.904358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.904834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.910072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.910072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.910072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.920329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 946/1907] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:22.924644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.940399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f882646-e587-4348-aae7-72b5213ea6ef admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:22.945646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31eacf-ef9e-41af-8bb2-b7ed5535c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:22.946333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31eacf-ef9e-41af-8bb2-b7ed5535c207 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:22.946646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31eacf-ef9e-41af-8bb2-b7ed5535c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:22.946929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31eacf-ef9e-41af-8bb2-b7ed5535c207 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:22.948955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31eacf-ef9e-41af-8bb2-b7ed5535c207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:22.950620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31eacf-ef9e-41af-8bb2-b7ed5535c207 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:22.962875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 962/1908] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:22.969378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:22.986398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c822e5-d034-4cd2-bf0d-79d0e130e0b7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:23.002600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:23.002600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.002600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.002600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] PATH_INFO: `/v3/projects/2830d17993c24d4ab172008da3909b95/users/f08af523921f4fe1b6f6a470fbcc77f0/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.014286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2830d17993c24d4ab172008da3909b95, user_id=f08af523921f4fe1b6f6a470fbcc77f0, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:23.019383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:23.117538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 947/1909] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:22 2021] PUT /identity/v3/projects/2830d17993c24d4ab172008da3909b95/users/f08af523921f4fe1b6f6a470fbcc77f0/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:23.128159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.128450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.128733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.162250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] MFA Rules not processed for user `f08af523921f4fe1b6f6a470fbcc77f0`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:23.163720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:23.255310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 963/1910] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:23 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:23.260826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:23.334138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a1a35-9dff-4470-b344-2fbc18e18f5c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:23.339086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:23.339767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.340057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.340334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.341046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:23.345945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:23.484195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 948/1911] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:23 2021] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:23.489068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:23.500068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa8826-3212-4443-b8dd-f297f693155b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:23.577835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:23.578527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.578843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.579112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.579836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:23.581812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:23.746316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 964/1912] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:23 2021] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:23.751084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:23.762476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713f2a5-c65b-4070-b6b6-5f84827ab8f7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:23.767252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:23.767915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.768193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.768466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.769218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:23.772290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:23.784588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 949/1913] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:23 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:23.789176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:23.801794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50268-e239-4f66-a7c2-0587cd926a08 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:23.807296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:23.809055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.809055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.809055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] PATH_INFO: `/v3/projects/14972408e0024fb29339efca51736336/users/295595bd2a714b80b24280d18244f027/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.827950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14972408e0024fb29339efca51736336, user_id=295595bd2a714b80b24280d18244f027, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:23.830988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:23.852441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:23.855393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:23.870589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1179a-80e1-4d07-8f94-ab1c9a9b3e8f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:23.878756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:23.890525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:23.891046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:23.891336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] PATH_INFO: `/v3/users/713c10bae54a4c82ae236226c5a0a08f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:23.893058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713c10bae54a4c82ae236226c5a0a08f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:23.897519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:23.983334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 965/1914] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:23 2021] PUT /identity/v3/projects/14972408e0024fb29339efca51736336/users/295595bd2a714b80b24280d18244f027/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:23.986962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:24.177603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd223f-dfee-46c7-b072-e79cccad1b12 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:24.177603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:24.177603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:24.177603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:24.178537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:24.178537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:24.178537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:24.178537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 966/1915] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:23 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:24.178537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:24.182982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f4d5-21bf-4247-b584-e472c9b679f3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:24.188268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648a73-ba61-4633-a80c-08c35ad64724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:24.189325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648a73-ba61-4633-a80c-08c35ad64724 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:24.189785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648a73-ba61-4633-a80c-08c35ad64724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:24.190195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648a73-ba61-4633-a80c-08c35ad64724 admin admin] PATH_INFO: `/v3/projects/14972408e0024fb29339efca51736336/users/295595bd2a714b80b24280d18244f027/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:24.193433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63648a73-ba61-4633-a80c-08c35ad64724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14972408e0024fb29339efca51736336, user_id=295595bd2a714b80b24280d18244f027, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:24.196372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63648a73-ba61-4633-a80c-08c35ad64724 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:24.209184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 967/1916] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:24 2021] PUT /identity/v3/projects/14972408e0024fb29339efca51736336/users/295595bd2a714b80b24280d18244f027/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:24.235539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:24.235820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:24.236173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:24.266835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] MFA Rules not processed for user `295595bd2a714b80b24280d18244f027`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:24.268091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:24.322421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713c10bae54a4c82ae236226c5a0a08f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:24.347851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 968/1917] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:24 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:24.780031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713c10bae54a4c82ae236226c5a0a08f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:24.800308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713c10bae54a4c82ae236226c5a0a08f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:24.802768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713c10bae54a4c82ae236226c5a0a08f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:24.803715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a0e5827e-b529-482d-a877-709d19ea2e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713c10bae54a4c82ae236226c5a0a08f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:24.811672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:24.813462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:24.827658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 950/1918] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:23 2021] DELETE /identity/v3/users/713c10bae54a4c82ae236226c5a0a08f => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:24.829540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:24.829861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:24.830119 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:24.855570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:24.855570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:24.901866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74106-f8e8-4df3-95af-3345b4da4ed1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:24.956715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 951/1919] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:24.970452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:24.970452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:24.983028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:24.983710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:24.984155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:24.984434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:24.987749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.043047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf2d9b-552f-4185-abd5-3a3207df824d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:25.047189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bf354-6203-456d-9396-0d1a63b6f473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:25.047851 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bf354-6203-456d-9396-0d1a63b6f473 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.048194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bf354-6203-456d-9396-0d1a63b6f473 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.048836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bf354-6203-456d-9396-0d1a63b6f473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.060412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bf354-6203-456d-9396-0d1a63b6f473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:25.062870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bf354-6203-456d-9396-0d1a63b6f473 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:25.077170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:25.078195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 952/1920] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:25.079136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee58936-8b24-413b-828a-2e6ebdc3b815 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.079433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee58936-8b24-413b-828a-2e6ebdc3b815 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.080030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee58936-8b24-413b-828a-2e6ebdc3b815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.081921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:25.094260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 969/1921] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:24 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:04:25.101157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5ee58936-8b24-413b-828a-2e6ebdc3b815 None None] MFA Rules not processed for user `a21ac4ce459d4eee9f73d4c7207968b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:25.102681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5ee58936-8b24-413b-828a-2e6ebdc3b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.166622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 953/1922] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:25 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:25.449326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:25.451927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.472087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efb3a1-c925-4a63-af7c-7c4297c08a10 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:25.479748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:25.479748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.479748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.479748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.481448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.550539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:25.552283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647560a7-e974-4df3-a96c-f538ca21ffb6 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:25.561816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 970/1923] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:25 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:25.580395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1af6c-84e7-458d-8178-c97a969043d7 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.580776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1af6c-84e7-458d-8178-c97a969043d7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.580776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1af6c-84e7-458d-8178-c97a969043d7 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.583840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 954/1924] 10.222.0.73 () {54 vars in 912 bytes} [Fri Aug 27 04:04:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:04:25.589584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.589807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.590095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.609336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:25.610583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.618784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 971/1925] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:04:25 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:04:25.631432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1af6c-84e7-458d-8178-c97a969043d7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:25.632049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:25.633606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.633712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-62d1af6c-84e7-458d-8178-c97a969043d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:25.652702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919be3-fb28-4ddc-b9c5-82a5009d7949 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:25.652950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1af6c-84e7-458d-8178-c97a969043d7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:25.663183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:25.663300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:25.663424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.663424 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.663580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:25.663670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] PATH_INFO: `/v3/projects/e7eaf96c3bb240b69d34cc18471c8e85` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.663754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:25.663754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:25.664146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7eaf96c3bb240b69d34cc18471c8e85)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:25.666175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:25.673042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:25.674657 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:25.683578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 972/1926] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:04:25.825501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7eaf96c3bb240b69d34cc18471c8e85', 'request_id': 'req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:25.831687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7eaf96c3bb240b69d34cc18471c8e85', 'request_id': 'req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.036939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7eaf96c3bb240b69d34cc18471c8e85', 'request_id': 'req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.048088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] The token cache is being invalidate because project e7eaf96c3bb240b69d34cc18471c8e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:26.048380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.049044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.050606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 955/1927] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:25 2021] DELETE /identity/v3/projects/e7eaf96c3bb240b69d34cc18471c8e85 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:26.055406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:26.066594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec644344-5750-4db4-a877-00df65772519 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:26.121897 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:26.122856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:26.123144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:26.123418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] PATH_INFO: `/v3/users/fda4d0415c314c0fad2474b5a1660f6c` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:26.124629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda4d0415c314c0fad2474b5a1660f6c)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:26.126540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:26.447018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda4d0415c314c0fad2474b5a1660f6c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.447748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda4d0415c314c0fad2474b5a1660f6c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.640402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda4d0415c314c0fad2474b5a1660f6c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.642259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda4d0415c314c0fad2474b5a1660f6c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.666162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b6cc62ea-3047-4665-99db-50347b477d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda4d0415c314c0fad2474b5a1660f6c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:26.682040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 973/1928] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:26 2021] DELETE /identity/v3/users/fda4d0415c314c0fad2474b5a1660f6c => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:27.220658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:27.225023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:27.236584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3af85-3a90-4ae7-9db4-e822d2510b9e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:27.298869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:27.299749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:27.300036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:27.300316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] PATH_INFO: `/v3/projects/567cac02e44b433f993efd40967f2920` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:27.302074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567cac02e44b433f993efd40967f2920)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:27.304075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:27.445482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567cac02e44b433f993efd40967f2920', 'request_id': 'req-1241d84b-9ae8-40a2-a82c-7072119b50a6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:27.451853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567cac02e44b433f993efd40967f2920', 'request_id': 'req-1241d84b-9ae8-40a2-a82c-7072119b50a6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:27.613112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567cac02e44b433f993efd40967f2920', 'request_id': 'req-1241d84b-9ae8-40a2-a82c-7072119b50a6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:27.625061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] The token cache is being invalidate because project 567cac02e44b433f993efd40967f2920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:27.625778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:27.626243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1241d84b-9ae8-40a2-a82c-7072119b50a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:27.627923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 956/1929] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:27 2021] DELETE /identity/v3/projects/567cac02e44b433f993efd40967f2920 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:27.634263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:27.634783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:27.635264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:27.656806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:27.657258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:27.720757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 974/1930] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:27.729343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:27.729629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:27.729933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:27.750440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:27.751695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:27.759737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 957/1931] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:27.764009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:27.774256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc469-c7ed-4d49-92e8-99d16d30aa8e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:27.779294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:27.779953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:27.780220 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:27.780502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:27.781228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:27.781532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:27.783169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:27.796523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 975/1932] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:04:27.800627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:27.810808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd51a19-c01b-4af0-bba5-05be1f32e3a7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:27.815894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:27.817383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:27.817383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:27.817383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:27.817963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:27.819913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:28.001519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 958/1933] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:27 2021] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:28.002866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:28.012824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478013f-a5d1-4707-a4f6-73bd20d4f502 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:28.070174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:28.071181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:28.075941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:28.075941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:28.075941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:28.075941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:28.187868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 976/1934] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:28 2021] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:28.189353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:28.201432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfaf8-f0e5-4834-8762-7456262e7de9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:28.206188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:28.206906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:28.207188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:28.208134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:28.208844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:28.214304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:28.344866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 959/1935] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:28.350243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:28.359756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b0118-17f0-42ab-830e-f8f3fcdbb71d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:28.365330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca33d-648e-48c9-b503-cdad533498a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:28.366308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca33d-648e-48c9-b503-cdad533498a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:28.366622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca33d-648e-48c9-b503-cdad533498a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:28.366906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca33d-648e-48c9-b503-cdad533498a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:28.367643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ca33d-648e-48c9-b503-cdad533498a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:28.369260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ca33d-648e-48c9-b503-cdad533498a7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:28.383809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 977/1936] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:28.385267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:28.396883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9371-ddcf-47ff-8973-91a4f4b66c65 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:28.413894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:28.416465 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:28.416919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:28.417203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] PATH_INFO: `/v3/projects/e6c589b3fc9f431c944348f671509cb2/users/4d72c11bbae34652aff5cc3b0c9d0310/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:28.432909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c589b3fc9f431c944348f671509cb2, user_id=4d72c11bbae34652aff5cc3b0c9d0310, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:28.435585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:28.552506 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 960/1937] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:28 2021] PUT /identity/v3/projects/e6c589b3fc9f431c944348f671509cb2/users/4d72c11bbae34652aff5cc3b0c9d0310/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:28.563685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:28.564088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:28.564471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:28.594208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] MFA Rules not processed for user `4d72c11bbae34652aff5cc3b0c9d0310`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:28.595613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:28.661271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 978/1938] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:28 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:28.667614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:28.748508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafec4c0-1040-46b4-a8a6-0db72bf0d41d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:28.752095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:28.752680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:28.753047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:28.753317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:28.754008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:28.757713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:28.930332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 961/1939] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:28 2021] POST /identity/v3/projects => generated 363 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:28.934654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:28.946733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1812d3-ffe5-45be-ba8c-720d02779081 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:29.009327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:29.010017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.010300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.010604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.013605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:29.013605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:29.094513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 979/1940] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:28 2021] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:04:29.101207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:29.109791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00870-6ce5-46e6-8f86-1d6468561fce admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:29.115297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:29.115969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.116248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.116522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.117247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:29.118866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:29.130701 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 962/1941] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:29.135019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:29.147811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba425767-4390-4457-a42a-61623c6a3bb5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:29.154930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:29.155972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.156337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.156677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] PATH_INFO: `/v3/projects/d7e1199fb4e44823bc94c8d02129c044/users/e6063e8412ee43beb4ea261440f6938c/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.192588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1199fb4e44823bc94c8d02129c044, user_id=e6063e8412ee43beb4ea261440f6938c, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:29.192588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:29.325322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 980/1942] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:29 2021] PUT /identity/v3/projects/d7e1199fb4e44823bc94c8d02129c044/users/e6063e8412ee43beb4ea261440f6938c/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:29.331133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:29.344884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6a92-602d-4be6-8e42-ae2e0fe5b562 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:29.423324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65dbaf-b01b-4e56-96a2-917332b1959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:29.424425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65dbaf-b01b-4e56-96a2-917332b1959d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.424425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65dbaf-b01b-4e56-96a2-917332b1959d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.424894 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65dbaf-b01b-4e56-96a2-917332b1959d admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.425807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65dbaf-b01b-4e56-96a2-917332b1959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:29.428413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65dbaf-b01b-4e56-96a2-917332b1959d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:29.448737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 963/1943] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:29 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:04:29.449934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:29.462883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633bb9-cb7d-4def-a8b7-2b5aa79329e9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:29.482107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:29.483064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.483339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.486975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] PATH_INFO: `/v3/projects/d7e1199fb4e44823bc94c8d02129c044/users/e6063e8412ee43beb4ea261440f6938c/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.491971 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1199fb4e44823bc94c8d02129c044, user_id=e6063e8412ee43beb4ea261440f6938c, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:29.494973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:29.515816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 981/1944] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:29 2021] PUT /identity/v3/projects/d7e1199fb4e44823bc94c8d02129c044/users/e6063e8412ee43beb4ea261440f6938c/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:29.528865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.529339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.529616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.563485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] MFA Rules not processed for user `e6063e8412ee43beb4ea261440f6938c`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:29.574694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:29.687824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 964/1945] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:29 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:29.701874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:29.703667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:29.781188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe20d0-13fd-419a-a26c-b584d154b54f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:29.784997 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:29.785883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:29.786175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:29.786451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:29.796621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:29.798111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:29.809826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 982/1946] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:29 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:30.377390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:30.378887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:30.397987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1b6c-7af3-4ef1-90e5-6c8558a4e30d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:30.402509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:30.403205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:30.403783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:30.404061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:30.475855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:30.477316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:30.488322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 965/1947] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:30 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:38.333082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:38.347126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16389a-8467-43c4-8f5a-e9b999945e27 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:38.356037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:38.356726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:38.357015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:38.357288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:38.359335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:38.457743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:38.459237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17382950-3965-4dda-b706-dd232e592f2c service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:38.469038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 983/1948] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:38 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:41.080119 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:41.082534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:41.186630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166a47-acf7-4bee-9d27-4e5bb0b1d5b5 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:41.197534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:41.198756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:41.199206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:41.199652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] PATH_INFO: `/v3/users/f08af523921f4fe1b6f6a470fbcc77f0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:41.201693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08af523921f4fe1b6f6a470fbcc77f0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:41.203829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:41.798923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08af523921f4fe1b6f6a470fbcc77f0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:41.928290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08af523921f4fe1b6f6a470fbcc77f0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:41.947014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08af523921f4fe1b6f6a470fbcc77f0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:41.947014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08af523921f4fe1b6f6a470fbcc77f0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:41.947014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08af523921f4fe1b6f6a470fbcc77f0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:41.958780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 966/1949] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:41 2021] DELETE /identity/v3/users/f08af523921f4fe1b6f6a470fbcc77f0 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:41.963453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:41.963999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:41.963999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:41.982569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:41.998178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:42.055508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 984/1950] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:42.065606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:42.067858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:42.144965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1fc98-799d-47d5-8e02-490f10d54b14 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:42.148896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:42.149645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:42.149949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:42.150221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:42.161083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:42.162216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:42.180539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 967/1951] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:04:42.663758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:42.665201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:42.677914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3de5e-3e1f-47d0-a81c-0b7da027186e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:42.683669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:42.684617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:42.684904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:42.685177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] PATH_INFO: `/v3/projects/2830d17993c24d4ab172008da3909b95` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:42.686368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2830d17993c24d4ab172008da3909b95)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:42.688648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:42.823676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2830d17993c24d4ab172008da3909b95', 'request_id': 'req-0a6ff228-f301-450a-a340-89e89f0b2bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:42.939539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2830d17993c24d4ab172008da3909b95', 'request_id': 'req-0a6ff228-f301-450a-a340-89e89f0b2bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:42.946350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2830d17993c24d4ab172008da3909b95', 'request_id': 'req-0a6ff228-f301-450a-a340-89e89f0b2bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:42.958952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] The token cache is being invalidate because project 2830d17993c24d4ab172008da3909b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:42.959416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:42.960122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:42.961794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 985/1952] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:42 2021] DELETE /identity/v3/projects/2830d17993c24d4ab172008da3909b95 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:04:42.966199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:42.978020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff731-b3c6-4af0-9597-fd8c56a95809 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:43.048297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:43.049172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:43.049449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:43.049718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] PATH_INFO: `/v3/users/295595bd2a714b80b24280d18244f027` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:43.050951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295595bd2a714b80b24280d18244f027)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:43.052879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:43.229369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295595bd2a714b80b24280d18244f027'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:43.321907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295595bd2a714b80b24280d18244f027'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:43.337407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295595bd2a714b80b24280d18244f027'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:43.338184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295595bd2a714b80b24280d18244f027'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:43.338915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bbb6c5d5-9df8-4283-9f6e-dd69c2ba06c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295595bd2a714b80b24280d18244f027'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:43.354013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 968/1953] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:04:42 2021] DELETE /identity/v3/users/295595bd2a714b80b24280d18244f027 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:43.764868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:43.766417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:43.785862 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff228-f301-450a-a340-89e89f0b2bd3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:43.864992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:43.865865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:43.866150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:43.866430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] PATH_INFO: `/v3/projects/14972408e0024fb29339efca51736336` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:43.867688 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=14972408e0024fb29339efca51736336)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:43.869616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:43.986130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14972408e0024fb29339efca51736336', 'request_id': 'req-42d80e3e-b090-420a-8134-5aef29ae34ec'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:44.099778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14972408e0024fb29339efca51736336', 'request_id': 'req-42d80e3e-b090-420a-8134-5aef29ae34ec'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:44.107843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14972408e0024fb29339efca51736336', 'request_id': 'req-42d80e3e-b090-420a-8134-5aef29ae34ec'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:44.124335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] The token cache is being invalidate because project 14972408e0024fb29339efca51736336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:04:44.124634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:44.125328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42d80e3e-b090-420a-8134-5aef29ae34ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:04:44.127114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 986/1954] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:04:43 2021] DELETE /identity/v3/projects/14972408e0024fb29339efca51736336 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:44.133782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.134063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.134337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.155831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:44.157026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:44.230516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 969/1955] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:44.246865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.247325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.247672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.266834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:44.268028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:44.278606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 987/1956] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:44.281080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:44.291204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00e397-3799-4a00-b66a-7711a4659b8c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:44.299009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:44.299009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.299009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.299009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.299819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:04:44.300187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:44.302508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:44.315017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 970/1957] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:04:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:04:44.319461 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:44.328708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31342e5-4e95-4c0d-b9ef-acb2b0251070 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:44.334459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:44.335182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.335468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.335746 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.336437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:44.338506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:44.480399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 988/1958] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:04:44 2021] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:44.487834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:44.497206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445083-d68b-466f-aace-4fbf94fa458f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:44.568344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:44.569040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.569320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.570202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.570334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:44.572343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:44.688716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 971/1959] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:04:44 2021] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:04:44.694187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:44.705686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d41f5-b471-4964-b8e4-81e1a68fb10a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:44.711799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:44.711799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.712654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.712938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.713677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:44.715475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:44.727642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 989/1960] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:44.734262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:44.746073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d5efd-e6c1-47fb-9c60-1b40e41d1222 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:44.752293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707c3c5-da90-42c7-9e63-d43dfd072cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:44.753198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707c3c5-da90-42c7-9e63-d43dfd072cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.753558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707c3c5-da90-42c7-9e63-d43dfd072cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.754472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707c3c5-da90-42c7-9e63-d43dfd072cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.755529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707c3c5-da90-42c7-9e63-d43dfd072cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:44.757325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707c3c5-da90-42c7-9e63-d43dfd072cb5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:44.768978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 972/1961] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:04:44.774105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:44.784404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a51a-3372-4b2d-9fdd-6030edec0300 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:44.790603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:44.792152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.792667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.793168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] PATH_INFO: `/v3/projects/a5e3353fe1114fdfb586f83b6c29fd51/users/b86e53e0b9a24b9f95a8b9ee61a35f30/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.811330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e3353fe1114fdfb586f83b6c29fd51, user_id=b86e53e0b9a24b9f95a8b9ee61a35f30, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:44.814320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:44.904807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 990/1962] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:04:44 2021] PUT /identity/v3/projects/a5e3353fe1114fdfb586f83b6c29fd51/users/b86e53e0b9a24b9f95a8b9ee61a35f30/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:04:44.915098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:44.915384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:44.915663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:44.951852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] MFA Rules not processed for user `b86e53e0b9a24b9f95a8b9ee61a35f30`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:04:44.953083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:45.026372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 973/1963] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:04:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:04:45.037580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:04:45.039843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:04:45.108977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1d427-081b-44e0-a060-b8b31ad37aca admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:04:45.112768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df568d4-842e-4609-9908-da58795904bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:04:45.114123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df568d4-842e-4609-9908-da58795904bb service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:04:45.114549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df568d4-842e-4609-9908-da58795904bb service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:04:45.114868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df568d4-842e-4609-9908-da58795904bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:04:45.123930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df568d4-842e-4609-9908-da58795904bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:04:45.125390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df568d4-842e-4609-9908-da58795904bb service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:04:45.135434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 991/1964] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:04:45 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:04.819724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:04.822248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:04.949793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192453b-7501-4a3e-89ad-e88975c0e66c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:04.958549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:04.960038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:04.960497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:04.960871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] PATH_INFO: `/v3/users/6a18e137c866424fa6e9253025383e3b` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:04.962499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a18e137c866424fa6e9253025383e3b)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:04.964578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:05.215882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a18e137c866424fa6e9253025383e3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:05.293912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:05.294460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:05.294460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:05.298612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a18e137c866424fa6e9253025383e3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:05.312370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a18e137c866424fa6e9253025383e3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:05.313080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a18e137c866424fa6e9253025383e3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:05.315154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-77b26bb1-d361-411b-b07b-74431bcdfe54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a18e137c866424fa6e9253025383e3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:05.320964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] MFA Rules not processed for user `a21ac4ce459d4eee9f73d4c7207968b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:05.322103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:05.326311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 974/1965] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:04 2021] DELETE /identity/v3/users/6a18e137c866424fa6e9253025383e3b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:05.330686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:05.331003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:05.331284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:05.353732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:05.354988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:05.384679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 992/1966] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:05 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:05.415904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 975/1967] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:05.426946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:05.428348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:05.486703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e0e4-1bdb-4d89-ac08-e34fa11b46dd None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:05.542232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc6522-b35b-415d-973c-cdbd97b249b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:05.542929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6522-b35b-415d-973c-cdbd97b249b6 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:05.543223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6522-b35b-415d-973c-cdbd97b249b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:05.543495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6522-b35b-415d-973c-cdbd97b249b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:05.554136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc6522-b35b-415d-973c-cdbd97b249b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:05.555729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc6522-b35b-415d-973c-cdbd97b249b6 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:05.565555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 993/1968] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:06.173648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:06.173648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:06.193269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380cf9-e756-4935-a11a-ef5dc5deaf40 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:06.199302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:06.200289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:06.200709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:06.201088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] PATH_INFO: `/v3/projects/996e2b5d376a4ad59407679005b3bd53` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:06.202439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=996e2b5d376a4ad59407679005b3bd53)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:06.204978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:06.352799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996e2b5d376a4ad59407679005b3bd53', 'request_id': 'req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:06.363084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996e2b5d376a4ad59407679005b3bd53', 'request_id': 'req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:06.431406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996e2b5d376a4ad59407679005b3bd53', 'request_id': 'req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:06.451543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] The token cache is being invalidate because project 996e2b5d376a4ad59407679005b3bd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:06.451543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:06.451543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c46e9f2c-1e54-4e04-bbfc-100b52d931f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:06.451543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 976/1969] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:06 2021] DELETE /identity/v3/projects/996e2b5d376a4ad59407679005b3bd53 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:06.453260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:06.453858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:06.453858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:06.477186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:06.478411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:06.536332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 994/1970] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:06.544957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:06.545179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:06.545459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:06.565112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:06.566419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:06.575122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 977/1971] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:06.579974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:06.598007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1a27-20ce-4e57-ae88-39410860ce0c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:06.605874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:06.607086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:06.607599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:06.608108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:06.609484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:06.610072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:06.612273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:06.629082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 995/1972] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:06.633798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:06.643318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61a5c-fa80-4f4a-aa90-1c587fae461b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:06.648300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:06.648954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:06.649235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:06.649525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:06.650299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:06.652131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:06.753627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 978/1973] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:06 2021] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:06.758336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:06.769309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60037eb-fbc8-4335-9bc2-3b2edec38cd8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:06.835970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:06.836675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:06.837038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:06.837342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:06.838063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:06.840069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:06.980571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 996/1974] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:06 2021] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:06.984862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:06.996577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329395c8-625e-4c54-be15-d18ce3e52675 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:07.001853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:07.002797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.003079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.006361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.006361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:07.006361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:07.018339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 979/1975] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:06 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:07.023151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:07.036397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17944f1-d25c-4f67-af53-4e8754cb0c58 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:07.041443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc04019-1400-4ff0-a72f-f23c3b9b2707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:07.046479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc04019-1400-4ff0-a72f-f23c3b9b2707 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.046479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc04019-1400-4ff0-a72f-f23c3b9b2707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.046479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc04019-1400-4ff0-a72f-f23c3b9b2707 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.046479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc04019-1400-4ff0-a72f-f23c3b9b2707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:07.046479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc04019-1400-4ff0-a72f-f23c3b9b2707 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:07.056341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 997/1976] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:07.060684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:07.071751 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5d5ca-48df-42aa-ab00-19f24c64dc31 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:07.076566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:07.077470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.077747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.078019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] PATH_INFO: `/v3/projects/6b8612f75c71468b95d9960219adef01/users/27713444381547efaa3c968c3c77bf03/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.095081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8612f75c71468b95d9960219adef01, user_id=27713444381547efaa3c968c3c77bf03, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:07.098707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:07.187690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 980/1977] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:07 2021] PUT /identity/v3/projects/6b8612f75c71468b95d9960219adef01/users/27713444381547efaa3c968c3c77bf03/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:07.198954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.199267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.199546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.227800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] MFA Rules not processed for user `27713444381547efaa3c968c3c77bf03`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:07.229011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:07.302661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 998/1978] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:07.314541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:07.317776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:07.393182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d33c0-fee8-4915-9f4b-c139a5146e90 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:07.398593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766c5d3-e392-4d3a-96a4-a813c36018d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:07.399531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766c5d3-e392-4d3a-96a4-a813c36018d4 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.399814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766c5d3-e392-4d3a-96a4-a813c36018d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.400867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766c5d3-e392-4d3a-96a4-a813c36018d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.412948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766c5d3-e392-4d3a-96a4-a813c36018d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:07.414406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766c5d3-e392-4d3a-96a4-a813c36018d4 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:07.424758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 981/1979] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:07 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:07.453240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:07.522980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e92a9-8b06-4da0-b85b-55c06d995d84 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:07.527769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:07.528660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.528944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.529224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] PATH_INFO: `/v3/users/27713444381547efaa3c968c3c77bf03` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.530513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27713444381547efaa3c968c3c77bf03)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:07.532463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:07.779422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27713444381547efaa3c968c3c77bf03'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:07.780331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27713444381547efaa3c968c3c77bf03'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:07.859954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27713444381547efaa3c968c3c77bf03'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:07.860608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27713444381547efaa3c968c3c77bf03'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:07.873717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27713444381547efaa3c968c3c77bf03'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:07.887470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 999/1980] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:07 2021] DELETE /identity/v3/users/27713444381547efaa3c968c3c77bf03 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:07.892134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:07.892427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:07.892707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:07.913461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:07.914745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:07.980098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 982/1981] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:07.990935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:07.992377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:08.057794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e3a50-726a-40c4-857e-a9b415caf269 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:08.061890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:08.062568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:08.062874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:08.063150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:08.072899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:08.074451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:08.084368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1000/1982] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:08.548016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:08.549565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:08.577053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de8aea-edc6-4be6-8aad-4a6675732c08 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:08.584844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:08.585742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:08.586043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:08.586376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] PATH_INFO: `/v3/projects/6b8612f75c71468b95d9960219adef01` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:08.587693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8612f75c71468b95d9960219adef01)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:08.589608 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:08.736846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8612f75c71468b95d9960219adef01', 'request_id': 'req-f5db60f1-6b2e-4d2d-a277-f8075da2186c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:08.746152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8612f75c71468b95d9960219adef01', 'request_id': 'req-f5db60f1-6b2e-4d2d-a277-f8075da2186c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:08.841909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8612f75c71468b95d9960219adef01', 'request_id': 'req-f5db60f1-6b2e-4d2d-a277-f8075da2186c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:08.854146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] The token cache is being invalidate because project 6b8612f75c71468b95d9960219adef01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:08.854606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:08.855460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f5db60f1-6b2e-4d2d-a277-f8075da2186c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:08.857059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 983/1983] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:08 2021] DELETE /identity/v3/projects/6b8612f75c71468b95d9960219adef01 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:10.493938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:10.495927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:10.515122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827fdcf-9b16-4b09-9d72-af2badc36b8f service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:10.585375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:10.586174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:10.586452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:10.586760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] PATH_INFO: `/v3/users/d77ffd431d9d4e7aafe19ac0234efc0a` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:10.588050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77ffd431d9d4e7aafe19ac0234efc0a)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:10.590440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:10.857648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77ffd431d9d4e7aafe19ac0234efc0a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:10.858350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77ffd431d9d4e7aafe19ac0234efc0a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:10.956770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77ffd431d9d4e7aafe19ac0234efc0a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:10.957493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77ffd431d9d4e7aafe19ac0234efc0a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:10.970957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77ffd431d9d4e7aafe19ac0234efc0a'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:10.989884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1001/1984] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:10 2021] DELETE /identity/v3/users/d77ffd431d9d4e7aafe19ac0234efc0a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:10.994177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:10.994714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:10.994938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:11.014034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:11.015317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:11.092328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 984/1985] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:11.105955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:11.108524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:11.188610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24931f-bba4-4b28-99f5-1d67ffc8c229 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:11.193171 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:11.194374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:11.194696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:11.194972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:11.208777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:11.210228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:11.224543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1002/1986] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:12.160323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:12.162282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:12.189578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94faaf-cace-4ed7-8dc7-303275c7f5de None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:12.201725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:12.202805 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:12.203089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:12.203364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] PATH_INFO: `/v3/projects/ff1ef1b3c2864e95a419533fab7faffb` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:12.204662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1ef1b3c2864e95a419533fab7faffb)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:12.206774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:12.363988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1ef1b3c2864e95a419533fab7faffb', 'request_id': 'req-ced0b178-e5a7-46c1-bb4f-04447c654201'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:12.370339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1ef1b3c2864e95a419533fab7faffb', 'request_id': 'req-ced0b178-e5a7-46c1-bb4f-04447c654201'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:12.436756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1ef1b3c2864e95a419533fab7faffb', 'request_id': 'req-ced0b178-e5a7-46c1-bb4f-04447c654201'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:12.453964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] The token cache is being invalidate because project ff1ef1b3c2864e95a419533fab7faffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:12.454357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:12.455778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:12.459112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 985/1987] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:12 2021] DELETE /identity/v3/projects/ff1ef1b3c2864e95a419533fab7faffb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:12.465011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:12.479195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d7a67-e921-4237-ac57-dfdee3fe318f service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:12.631803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:12.631803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:12.631803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:12.631803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] PATH_INFO: `/v3/users/0e6f013341254ecf99687e382835bff0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:12.632345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6f013341254ecf99687e382835bff0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:12.632345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:12.979525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6f013341254ecf99687e382835bff0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:12.980678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6f013341254ecf99687e382835bff0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.128417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6f013341254ecf99687e382835bff0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.132833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6f013341254ecf99687e382835bff0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.156818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6f013341254ecf99687e382835bff0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.175458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1003/1988] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:12 2021] DELETE /identity/v3/users/0e6f013341254ecf99687e382835bff0 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:13.369083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:13.370532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:13.384225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0b178-e5a7-46c1-bb4f-04447c654201 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:13.444734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:13.445628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:13.445970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:13.446276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] PATH_INFO: `/v3/users/4d72c11bbae34652aff5cc3b0c9d0310` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:13.447651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d72c11bbae34652aff5cc3b0c9d0310)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:13.449686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:13.682632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d72c11bbae34652aff5cc3b0c9d0310'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.803297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:13.806958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:13.821494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d72c11bbae34652aff5cc3b0c9d0310'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.831247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93102336-be6a-4aa3-a5a4-077c3175da11 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:13.836897 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:13.837926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d72c11bbae34652aff5cc3b0c9d0310'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.838590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:13.838727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d72c11bbae34652aff5cc3b0c9d0310'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.839207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:13.839316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-83aee169-912f-4415-824f-c32a3e318765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d72c11bbae34652aff5cc3b0c9d0310'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:13.839847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] PATH_INFO: `/v3/projects/4b3cfb2433874983af393c8f29341ae2` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:13.841484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3cfb2433874983af393c8f29341ae2)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:13.844945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:13.853791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 986/1989] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:13 2021] DELETE /identity/v3/users/4d72c11bbae34652aff5cc3b0c9d0310 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:13.861279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:13.861574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:13.861841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:13.884593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:13.885847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:13.977078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 987/1990] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:14.003039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:14.004862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:14.028811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3cfb2433874983af393c8f29341ae2', 'request_id': 'req-faad50ba-a59b-40c7-b958-ba618ed96826'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:14.092627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f6f62-b8ca-439b-966c-528a6d826b4d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:14.123810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3cfb2433874983af393c8f29341ae2', 'request_id': 'req-faad50ba-a59b-40c7-b958-ba618ed96826'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:14.133019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3cfb2433874983af393c8f29341ae2', 'request_id': 'req-faad50ba-a59b-40c7-b958-ba618ed96826'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:14.147935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] The token cache is being invalidate because project 4b3cfb2433874983af393c8f29341ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:14.148508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:14.149195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-faad50ba-a59b-40c7-b958-ba618ed96826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:14.150935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1004/1991] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:13 2021] DELETE /identity/v3/projects/4b3cfb2433874983af393c8f29341ae2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:14.159611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc903ad-b47f-4d0d-ab69-c414d0e1c490 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:14.161474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc903ad-b47f-4d0d-ab69-c414d0e1c490 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:14.161962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc903ad-b47f-4d0d-ab69-c414d0e1c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:14.184325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-afc903ad-b47f-4d0d-ab69-c414d0e1c490 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:14.185560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-afc903ad-b47f-4d0d-ab69-c414d0e1c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:14.190848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:14.192115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:14.192272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:14.192609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:14.195149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:14.279837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1005/1992] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:14.281203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:14.281703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:14.282166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:14.286231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:14.288221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:14.302081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 988/1993] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:14.306459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:14.307818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:14.322956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1006/1994] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:14.324523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:14.337184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d97012-9ee0-408b-9aea-664f0225d215 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:14.343071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:14.343692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:14.343974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:14.344251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:14.345582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:14.345582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:14.347139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:14.366889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 989/1995] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:14.369658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:14.381044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47459a0-89cf-4ae4-837e-a8b6c53f28ad None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:14.386017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:14.386735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:14.387037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:14.387309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:14.389281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:14.389281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:14.697004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1007/1996] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:14 2021] POST /identity/v3/projects => generated 373 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:14.702331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:14.712451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e584010-925f-4dfe-ad81-56af06604c69 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:14.792720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:14.794058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:14.794875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:14.795500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:14.796718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:14.798822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:14.983101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 990/1997] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:14 2021] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:14.984374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.001270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d81b7-3928-4fb8-866e-aebe9690be41 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.013515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.014290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.017699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.017699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.017699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.019052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:15.036567 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1008/1998] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:15.041551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.052774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874be1-7437-4ae2-91eb-b873532ebdb0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.058185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.058943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.059232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.059653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.060595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.062139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:15.084916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 991/1999] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:15.086412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.098002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc953c-af73-4a64-8c28-857e6744385d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.105572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.107391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.107791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.108255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] PATH_INFO: `/v3/projects/45aaa5f8ac7145c0b412b6f2ae5785d0/users/ece4dd39d28a4934952ac41c317677ba/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.130082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.131964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:15.157780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45aaa5f8ac7145c0b412b6f2ae5785d0, user_id=ece4dd39d28a4934952ac41c317677ba, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.158305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:15.258435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1009/2000] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:15 2021] PUT /identity/v3/projects/45aaa5f8ac7145c0b412b6f2ae5785d0/users/ece4dd39d28a4934952ac41c317677ba/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:15.267534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.272162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:15.276372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11dd62-62ed-4f86-b1e3-081076c922a8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.376632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.376632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.376632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.376632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] PATH_INFO: `/v3/users/3383e658085a4ae1ae783bc3e90e42b4` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.378329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3383e658085a4ae1ae783bc3e90e42b4)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.383227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:15.449177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c95dc-dde5-4694-bc7f-a6b0a3723e8b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.456150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.457785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.458137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.458526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] PATH_INFO: `/v3/projects/e6c589b3fc9f431c944348f671509cb2` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.460092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c589b3fc9f431c944348f671509cb2)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.462087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:15.627891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3383e658085a4ae1ae783bc3e90e42b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.632621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c589b3fc9f431c944348f671509cb2', 'request_id': 'req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.716930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3383e658085a4ae1ae783bc3e90e42b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.734868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3383e658085a4ae1ae783bc3e90e42b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.735611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3383e658085a4ae1ae783bc3e90e42b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.736515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f1042aa0-2654-4dbf-b683-5a648ade9e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3383e658085a4ae1ae783bc3e90e42b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.750962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 992/2001] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:15 2021] DELETE /identity/v3/users/3383e658085a4ae1ae783bc3e90e42b4 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:15.752296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.752582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.752859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.779680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c589b3fc9f431c944348f671509cb2', 'request_id': 'req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.787617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c589b3fc9f431c944348f671509cb2', 'request_id': 'req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.794376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] MFA Rules not processed for user `ece4dd39d28a4934952ac41c317677ba`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:15.796717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:15.803072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] The token cache is being invalidate because project e6c589b3fc9f431c944348f671509cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:15.803812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.804524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:15.807167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1010/2002] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:15 2021] DELETE /identity/v3/projects/e6c589b3fc9f431c944348f671509cb2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:15.811165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.813634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:15.873924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 993/2003] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:15.879496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:15.881461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:15.901452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7bc16-e9d4-40e3-a72c-c2a9fa89c40f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.951037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77293c74-8666-49fa-a8a5-28e9a8494477 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:15.955930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.957364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.957856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.958380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.959180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.961104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:15.964357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:15.965393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:15.969206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:15.969206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] PATH_INFO: `/v3/users/e6063e8412ee43beb4ea261440f6938c` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:15.969206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6063e8412ee43beb4ea261440f6938c)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:15.969206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.102174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 994/2004] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:15 2021] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:16.103051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.104619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:16.166280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd958b-19dc-4e21-8b98-a002a7712ead admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.174913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.176394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.176892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.177385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] PATH_INFO: `/v3/projects/a2a4f9dd7d714d20afb13bd273d14061` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.179492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a4f9dd7d714d20afb13bd273d14061)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.182902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.228188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6063e8412ee43beb4ea261440f6938c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.228869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6063e8412ee43beb4ea261440f6938c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.323182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a4f9dd7d714d20afb13bd273d14061', 'request_id': 'req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.327728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6063e8412ee43beb4ea261440f6938c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.328483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6063e8412ee43beb4ea261440f6938c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.329478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a4f9dd7d714d20afb13bd273d14061', 'request_id': 'req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.341968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6063e8412ee43beb4ea261440f6938c'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.355900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1011/2005] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:15 2021] DELETE /identity/v3/users/e6063e8412ee43beb4ea261440f6938c => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:16.356781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.358065 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:16.432655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a77e3-a844-47cf-bcc9-9e749402239c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.443191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a4f9dd7d714d20afb13bd273d14061', 'request_id': 'req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.445153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0424-b4ad-4271-a87d-f3de91ffc97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.446040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0424-b4ad-4271-a87d-f3de91ffc97e admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.447941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0424-b4ad-4271-a87d-f3de91ffc97e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.448392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0424-b4ad-4271-a87d-f3de91ffc97e admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.449580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0424-b4ad-4271-a87d-f3de91ffc97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.454877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0424-b4ad-4271-a87d-f3de91ffc97e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.461198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] The token cache is being invalidate because project a2a4f9dd7d714d20afb13bd273d14061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:16.461631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.463427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2c0aa6b5-8e67-46c6-b695-b4ce0fd1e270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:16.466126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 995/2006] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:16 2021] DELETE /identity/v3/projects/a2a4f9dd7d714d20afb13bd273d14061 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:16.472441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.473497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.474103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.537629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:16.538902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:16.547553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 996/2007] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:16.591346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1012/2008] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:16 2021] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:16.602956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.602956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.602956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.603288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.603288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:16.615144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:16.616397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:16.628188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6597cc-9c1c-489d-b71c-87f84e5f74a4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.637082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.639547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.648464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.648464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.648464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.648464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.649019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1013/2009] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:16.649215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.657661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 997/2010] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:16.658820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca105d3-409a-4c14-9b34-956cf00a03d3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.662704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.665707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.666471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.666847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.667246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.668007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:16.668391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.670392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.674548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831623b-c45f-40ed-9862-e47606d5e38e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.682803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.682803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.682803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.682803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] PATH_INFO: `/v3/projects/594c2340f79842b5b16c34377e6d7377/users/9dbc0c31f199486397b6569f377c633c/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.699384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1014/2011] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:05:16.702687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=594c2340f79842b5b16c34377e6d7377, user_id=9dbc0c31f199486397b6569f377c633c, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.703541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.708545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.714724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a82775-da8d-449b-b337-3df646972a79 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.720042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.720694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.720985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.721366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.722075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.724794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.804401 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 998/2012] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:16 2021] PUT /identity/v3/projects/594c2340f79842b5b16c34377e6d7377/users/9dbc0c31f199486397b6569f377c633c/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:16.808323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.856132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1015/2013] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:16 2021] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:16.857199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.873587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d477a89-392b-4a81-8ca8-e5f162f294ed admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.919526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b16527-47ab-496d-b29a-ad4ae509479f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.924465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.925138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.925469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.926175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.926674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.928812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.929289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.929960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.930244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.930523 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.931280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.935839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:16.950205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 999/2014] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:16.950205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:16.950205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:16.963186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038a84-6bae-4b3b-91f6-d3636931febd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:16.968268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:16.969186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:16.969474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:16.969754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] PATH_INFO: `/v3/projects/d7e1199fb4e44823bc94c8d02129c044` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:16.971425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e1199fb4e44823bc94c8d02129c044)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:16.973514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.036393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1016/2015] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:16 2021] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:17.037454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.048230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e1f63-e178-489c-a3c8-a9b5388714f0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.053726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.054662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.054945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.055218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] PATH_INFO: `/v3/projects/594c2340f79842b5b16c34377e6d7377/users/9dbc0c31f199486397b6569f377c633c/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.057286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594c2340f79842b5b16c34377e6d7377, user_id=9dbc0c31f199486397b6569f377c633c, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.060010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.071547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1017/2016] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:17 2021] PUT /identity/v3/projects/594c2340f79842b5b16c34377e6d7377/users/9dbc0c31f199486397b6569f377c633c/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:17.072454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.127941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e1199fb4e44823bc94c8d02129c044', 'request_id': 'req-ffe6993d-d66a-41ea-ba43-217e2c614ae5'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:17.135048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e1199fb4e44823bc94c8d02129c044', 'request_id': 'req-ffe6993d-d66a-41ea-ba43-217e2c614ae5'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:17.136493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6be9d-0562-44b2-a84b-97d5ca75e346 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.200448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2f63d-8926-4747-819c-52297b09bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.201079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f63d-8926-4747-819c-52297b09bd9d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.201332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f63d-8926-4747-819c-52297b09bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.201606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f63d-8926-4747-819c-52297b09bd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.202335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f63d-8926-4747-819c-52297b09bd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.203990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f63d-8926-4747-819c-52297b09bd9d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.213804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e1199fb4e44823bc94c8d02129c044', 'request_id': 'req-ffe6993d-d66a-41ea-ba43-217e2c614ae5'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:17.220422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1018/2017] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:17 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:17.223573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4d84-742b-43bf-b76e-86bef0299bc5 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.223573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4d84-742b-43bf-b76e-86bef0299bc5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.223573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4d84-742b-43bf-b76e-86bef0299bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.226006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] The token cache is being invalidate because project d7e1199fb4e44823bc94c8d02129c044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:17.226296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:17.226995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:17.228560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1000/2018] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:16 2021] DELETE /identity/v3/projects/d7e1199fb4e44823bc94c8d02129c044 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:17.229676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.234796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.249148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6993d-d66a-41ea-ba43-217e2c614ae5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.252010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b2aa4d84-742b-43bf-b76e-86bef0299bc5 None None] MFA Rules not processed for user `9dbc0c31f199486397b6569f377c633c`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:17.252010 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b2aa4d84-742b-43bf-b76e-86bef0299bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.255862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1068f6-5b4e-4100-a18e-4298d02f3a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.256545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1068f6-5b4e-4100-a18e-4298d02f3a5b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.256830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1068f6-5b4e-4100-a18e-4298d02f3a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.257109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1068f6-5b4e-4100-a18e-4298d02f3a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.257925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1068f6-5b4e-4100-a18e-4298d02f3a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.259631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1068f6-5b4e-4100-a18e-4298d02f3a5b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.271932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1001/2019] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:17 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:17.273109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.273397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.273678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.294180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:17.295437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.317148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1002/2020] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:17.317148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.327904 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e726-b8dc-4487-848a-83644dee1cf1 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.335426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.336672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1019/2021] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:17.336874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.337332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.338196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] PATH_INFO: `/v3/projects/ee91a9a9c2964e949f86a12a1bce3380/users/966d8575fef64dca810656c02a1eea69/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.338922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427392ab-213a-486a-becd-200c0acdde7b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.339377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427392ab-213a-486a-becd-200c0acdde7b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.339659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427392ab-213a-486a-becd-200c0acdde7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.360743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-427392ab-213a-486a-becd-200c0acdde7b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:17.362070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-427392ab-213a-486a-becd-200c0acdde7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.364071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee91a9a9c2964e949f86a12a1bce3380, user_id=966d8575fef64dca810656c02a1eea69, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.366899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.372103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1020/2022] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:17.373013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427392ab-213a-486a-becd-200c0acdde7b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.374507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-427392ab-213a-486a-becd-200c0acdde7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.449541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427392ab-213a-486a-becd-200c0acdde7b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.455371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.456356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.456867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.457162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.459167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.482924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1003/2023] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:17 2021] PUT /identity/v3/projects/ee91a9a9c2964e949f86a12a1bce3380/users/966d8575fef64dca810656c02a1eea69/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:17.493077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.525864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.527368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d542dcf-707c-4278-b304-8aac6d8a4524 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.537046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1021/2024] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:17 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:17.538528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.538943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.539118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.569397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8132a-6a90-44a3-afd7-5e0ab56169b9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.573157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] MFA Rules not processed for user `966d8575fef64dca810656c02a1eea69`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:17.574589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:17.574887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.575598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.575937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.576388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.578027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:17.578488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.581482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.598275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1004/2025] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:17.603902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.619321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b930-0ba0-4ac6-8194-b3b952ad446a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.624917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.625592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.625869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.626195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.626926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.629441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.658450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1022/2026] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:17.663836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.679235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c74a-996f-4aae-b40d-728fff90ea24 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.686221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.687071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.689136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.689136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.689136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.691819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.768144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1005/2027] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:17.772209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.887286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83c7e-5be0-47bf-96f0-09a769131e4a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.892576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.893257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.893539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.893820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.894737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.896834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:17.913228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1023/2028] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/projects => generated 405 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:17.917092 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:17.978962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56d2f0-ab52-4b9a-9174-9dcf8be1986f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:17.983586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:17.984262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:17.984546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:17.984821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:17.985541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:17.987494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.075922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1006/2029] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:18.075922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.084022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048a6a-09df-45ad-aeda-d405ad1c53e8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.088878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.089571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.089852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.090130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.090897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.092567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.103593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1007/2030] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:18.107595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.117736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76939-b3a0-4dea-a1dd-cdc4ed5c1c1e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.122404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.123084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.123375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.123652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.124371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.125940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.136367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1008/2031] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:18.140397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.150934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1a93-37ee-40ec-b44b-f4270ac44d26 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.155572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde00cd-e67d-4e1f-90a4-07a2a502b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.156441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde00cd-e67d-4e1f-90a4-07a2a502b31c admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.156724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde00cd-e67d-4e1f-90a4-07a2a502b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.156999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde00cd-e67d-4e1f-90a4-07a2a502b31c admin admin] PATH_INFO: `/v3/projects/9b5c34642e104d708150f0365e4ca888/users/231b6ac082164da799a03c79d66fe048/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.172839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde00cd-e67d-4e1f-90a4-07a2a502b31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5c34642e104d708150f0365e4ca888, user_id=231b6ac082164da799a03c79d66fe048, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.175639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde00cd-e67d-4e1f-90a4-07a2a502b31c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.251919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1024/2032] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:17 2021] POST /identity/v3/users => generated 309 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:18.255528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.266706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d8bc-7592-4261-846a-41c6f9a82009 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.271920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.272588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.272889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.273148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.273896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.275563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.286140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1025/2033] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:18.290242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.300063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1cb13-d0b5-4b88-bdf1-e51ad38d95b9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.305274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.310756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.310756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.310756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] PATH_INFO: `/v3/projects/7504ed5b28a944e4b40078a4f84c736f/users/52fc4cd706bc48b093a664015bc6bafc/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.321116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7504ed5b28a944e4b40078a4f84c736f, user_id=52fc4cd706bc48b093a664015bc6bafc, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.323763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.372548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1009/2034] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:18 2021] PUT /identity/v3/projects/9b5c34642e104d708150f0365e4ca888/users/231b6ac082164da799a03c79d66fe048/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:18.383051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.383344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.383631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.413323 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] MFA Rules not processed for user `231b6ac082164da799a03c79d66fe048`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:18.417028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:18.482455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1026/2035] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:18 2021] PUT /identity/v3/projects/7504ed5b28a944e4b40078a4f84c736f/users/52fc4cd706bc48b093a664015bc6bafc/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:18.483052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1010/2036] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:18 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:18.486249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.489940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.561708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f259c-dc31-4def-8782-7372cf47746b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.565313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe018-9973-473b-8a6f-590a1d9260b3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.569036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.572913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.572913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.572913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.573167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.573272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.573366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.573366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.573366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.573366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.573601 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.574730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.586906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1027/2037] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:18.591477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.602874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593726f-10d5-4be2-83c2-c5fbc6b5ec02 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.607940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904434ce-8f5d-44d0-886d-401f7f3f6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.608844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904434ce-8f5d-44d0-886d-401f7f3f6749 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.609121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904434ce-8f5d-44d0-886d-401f7f3f6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.609394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904434ce-8f5d-44d0-886d-401f7f3f6749 admin admin] PATH_INFO: `/v3/projects/7504ed5b28a944e4b40078a4f84c736f/users/52fc4cd706bc48b093a664015bc6bafc/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.611503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904434ce-8f5d-44d0-886d-401f7f3f6749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7504ed5b28a944e4b40078a4f84c736f, user_id=52fc4cd706bc48b093a664015bc6bafc, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.614909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904434ce-8f5d-44d0-886d-401f7f3f6749 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.625813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1028/2038] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:18 2021] PUT /identity/v3/projects/7504ed5b28a944e4b40078a4f84c736f/users/52fc4cd706bc48b093a664015bc6bafc/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:18.638206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.638755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.639027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.679891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] MFA Rules not processed for user `52fc4cd706bc48b093a664015bc6bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:18.681161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:18.713985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1011/2039] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:18 2021] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:18.718066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.772822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1029/2040] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:18 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:18.783130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.791170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6dfbb-cb85-4184-bb32-fad189392d5c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.796822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.797599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.798061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.798223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.798991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.801268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.849329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f5591-ac5f-4458-a363-0c6db109257e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.902545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:18.903238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:18.903512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:18.903793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:18.961856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1012/2041] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:18 2021] POST /identity/v3/users => generated 307 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:18.967794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:18.989197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7a2ae-03e3-4b8c-a19c-1d24a8a79371 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:18.994129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:18.994129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:18.998935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.000171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.000641 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.001101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.002042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.003287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1030/2042] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:18 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:19.004349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.020535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1013/2043] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:19.024668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:19.043088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f144c-836b-4832-be3f-7255d74c2bb2 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:19.051234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.052318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.052668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.053014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] PATH_INFO: `/v3/projects/ef22ee6ec3414624888b2a0c2080b6f8/users/2f17f3974b154c1b862aa23e786b6509/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.083040 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef22ee6ec3414624888b2a0c2080b6f8, user_id=2f17f3974b154c1b862aa23e786b6509, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.084876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.179779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1031/2044] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:19 2021] PUT /identity/v3/projects/ef22ee6ec3414624888b2a0c2080b6f8/users/2f17f3974b154c1b862aa23e786b6509/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:19.183867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:19.194125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7af01-cd38-4e3e-8537-39d94fa6e6b3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:19.247237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50caa8f-7c5a-446a-bfa7-d9851393cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.247952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50caa8f-7c5a-446a-bfa7-d9851393cc6a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.248232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50caa8f-7c5a-446a-bfa7-d9851393cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.248505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50caa8f-7c5a-446a-bfa7-d9851393cc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.249230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50caa8f-7c5a-446a-bfa7-d9851393cc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.250838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50caa8f-7c5a-446a-bfa7-d9851393cc6a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.261670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1014/2045] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:19.265896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:19.277346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dc8f4-0a53-4a67-b5dc-f7a04e807b6e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:19.282499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.283405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.283690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.283967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] PATH_INFO: `/v3/projects/ef22ee6ec3414624888b2a0c2080b6f8/users/2f17f3974b154c1b862aa23e786b6509/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.285931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef22ee6ec3414624888b2a0c2080b6f8, user_id=2f17f3974b154c1b862aa23e786b6509, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.288615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.299164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1032/2046] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:19 2021] PUT /identity/v3/projects/ef22ee6ec3414624888b2a0c2080b6f8/users/2f17f3974b154c1b862aa23e786b6509/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:19.309266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.309558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.309844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.337631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] MFA Rules not processed for user `2f17f3974b154c1b862aa23e786b6509`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:19.338886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:19.409044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1015/2047] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:19 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:19.419073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:19.420783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:19.484671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aab5c-9ada-436d-90d2-291c6d183968 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:19.488687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.489343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.489626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.489899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.500980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.502447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.516046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1033/2048] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:19 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:19.626737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:19.690083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb39ece-2aa8-4154-a9e4-e805ca2acd4b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:19.757897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.757897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.757897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.757897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] PATH_INFO: `/v3/users/966d8575fef64dca810656c02a1eea69` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.759010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966d8575fef64dca810656c02a1eea69)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.759010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.839405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:19.849452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f780e8-d25f-4f34-b39f-f5dbd79cced3 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:19.853428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e561d0-205a-41ed-bdc5-2a83f643e1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:19.854131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e561d0-205a-41ed-bdc5-2a83f643e1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:19.854406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e561d0-205a-41ed-bdc5-2a83f643e1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:19.854760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e561d0-205a-41ed-bdc5-2a83f643e1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:19.919114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e561d0-205a-41ed-bdc5-2a83f643e1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:19.920559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e561d0-205a-41ed-bdc5-2a83f643e1b2 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:19.930100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1034/2049] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:19 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:20.011831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966d8575fef64dca810656c02a1eea69'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:20.133493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966d8575fef64dca810656c02a1eea69'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:20.163595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966d8575fef64dca810656c02a1eea69'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:20.164343 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966d8575fef64dca810656c02a1eea69'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:20.165284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966d8575fef64dca810656c02a1eea69'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:20.180431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1016/2050] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:19 2021] DELETE /identity/v3/users/966d8575fef64dca810656c02a1eea69 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:20.184981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:20.184981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:20.185253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:20.202862 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:20.204071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:20.276274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1035/2051] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:20.286451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:20.287975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:20.368652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83047-c329-4ad4-bb95-8212210b5326 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:20.372349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:20.372981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:20.373265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:20.373543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:20.383365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:20.384792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:20.394837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1017/2052] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:20.868152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:20.870006 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:20.883593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7061e-d6e6-4b0c-80cc-7a7c244b50f0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:20.890167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:20.891062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:20.891465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:20.891611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] PATH_INFO: `/v3/projects/ee91a9a9c2964e949f86a12a1bce3380` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:20.892866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee91a9a9c2964e949f86a12a1bce3380)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:20.894835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:20.995164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee91a9a9c2964e949f86a12a1bce3380', 'request_id': 'req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.053755 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee91a9a9c2964e949f86a12a1bce3380', 'request_id': 'req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.059964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee91a9a9c2964e949f86a12a1bce3380', 'request_id': 'req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.071470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] The token cache is being invalidate because project ee91a9a9c2964e949f86a12a1bce3380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:21.071756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.072406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.073951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1036/2053] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:20 2021] DELETE /identity/v3/projects/ee91a9a9c2964e949f86a12a1bce3380 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:21.078176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:21.088489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ded7d-83f6-440b-b74d-53722ad53ae8 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:21.143717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:21.145047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:21.145529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:21.145745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] PATH_INFO: `/v3/users/52fc4cd706bc48b093a664015bc6bafc` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:21.146983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fc4cd706bc48b093a664015bc6bafc)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:21.148885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:21.406435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fc4cd706bc48b093a664015bc6bafc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.539476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fc4cd706bc48b093a664015bc6bafc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.552449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fc4cd706bc48b093a664015bc6bafc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.553158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fc4cd706bc48b093a664015bc6bafc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.553767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a749047e-bdd1-4920-a464-b8e9c9148ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fc4cd706bc48b093a664015bc6bafc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:21.571863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1018/2054] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:21 2021] DELETE /identity/v3/users/52fc4cd706bc48b093a664015bc6bafc => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:22.078473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:22.080162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:22.101230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b9e3-2f8b-4bc3-b254-d34d6163b88b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:22.162917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:22.163775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.164059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.164331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] PATH_INFO: `/v3/projects/7504ed5b28a944e4b40078a4f84c736f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.165496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7504ed5b28a944e4b40078a4f84c736f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:22.167427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:22.311091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7504ed5b28a944e4b40078a4f84c736f', 'request_id': 'req-b7f8e2a4-1456-4a8e-b255-664864fd24df'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:22.413532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7504ed5b28a944e4b40078a4f84c736f', 'request_id': 'req-b7f8e2a4-1456-4a8e-b255-664864fd24df'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:22.419711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7504ed5b28a944e4b40078a4f84c736f', 'request_id': 'req-b7f8e2a4-1456-4a8e-b255-664864fd24df'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:22.431805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] The token cache is being invalidate because project 7504ed5b28a944e4b40078a4f84c736f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:22.432098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:22.432767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b7f8e2a4-1456-4a8e-b255-664864fd24df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:22.434303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1037/2055] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:22 2021] DELETE /identity/v3/projects/7504ed5b28a944e4b40078a4f84c736f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:22.440293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.440717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.441492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.462115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:22.463406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:22.524050 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1019/2056] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:22.532628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.532922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.533207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.553169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:22.554445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:22.562957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1038/2057] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:22.567870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:22.579324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950c33-cbe2-4728-acbe-ddd8a48343d4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:22.584115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:22.585137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.585599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.586061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.587155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:22.587643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:22.589434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:22.602282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1020/2058] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:05:22.606952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:22.617195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2311e2b-3780-4d66-90f0-86072ed56f1b None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:22.622224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:22.622975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.623257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.623534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.624223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:22.626158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:22.748155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1039/2059] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:22 2021] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:22.752352 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:22.763574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0b072-6424-4ca1-9bcf-9fa543123314 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:22.820738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:22.821384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.821667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.821966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.822706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:22.824886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:22.931091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1021/2060] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:22 2021] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:22.932312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:22.942713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56029d4e-28d7-40aa-98e1-fbd91cbe9f0a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:22.947971 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:22.948738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.949084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.949424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.950217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:22.951994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:22.963149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1040/2061] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:22.967223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:22.978498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39eb6-013c-42af-b551-f6efeed4c4d0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:22.983199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a30998-eec4-4911-a17f-0c6f034c6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:22.983870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30998-eec4-4911-a17f-0c6f034c6b01 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:22.984238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30998-eec4-4911-a17f-0c6f034c6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:22.984514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30998-eec4-4911-a17f-0c6f034c6b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:22.985248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a30998-eec4-4911-a17f-0c6f034c6b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:22.986998 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a30998-eec4-4911-a17f-0c6f034c6b01 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:22.998270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1022/2062] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:23.002423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.012434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7b4a-4e1f-46c0-8bf1-10414ea95a33 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.017154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.018032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.018313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.018616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] PATH_INFO: `/v3/projects/4c250d3399944fbab340db9825622412/users/ee017a484ded4658bd068b90245b4dc3/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.033323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c250d3399944fbab340db9825622412, user_id=ee017a484ded4658bd068b90245b4dc3, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.036622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.134276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1041/2063] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:23 2021] PUT /identity/v3/projects/4c250d3399944fbab340db9825622412/users/ee017a484ded4658bd068b90245b4dc3/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:23.144405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.144702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.144990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.172252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] MFA Rules not processed for user `ee017a484ded4658bd068b90245b4dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:23.173535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:23.237744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1023/2064] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:23 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:23.242949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.302621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54302fb-9a3d-43fd-9274-7b88cfa58703 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.307260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.307918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.308201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.308477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.309175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.311129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.432552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1042/2065] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:23 2021] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:23.437794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.448405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dbc64-91cd-4577-9aa3-6a8ea9b668c0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.505575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.505703 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.505928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.506283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.506935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.508858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.589324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1024/2066] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:23 2021] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:23.590826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.603139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5326a-1e82-4750-9bff-1c0b1da53b84 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.608253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.608872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.609194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.609481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.610208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.611895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.623150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1043/2067] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:23.627612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.638638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4def8-c395-423e-a0a5-4ec66e83ef27 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.643535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.644957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.645229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.645600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] PATH_INFO: `/v3/projects/fa083081200e4abf847de1ad90de13f1/users/dd1931a266064f9d9c6bde1b17876d48/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.662361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa083081200e4abf847de1ad90de13f1, user_id=dd1931a266064f9d9c6bde1b17876d48, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.665202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.779620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1025/2068] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:23 2021] PUT /identity/v3/projects/fa083081200e4abf847de1ad90de13f1/users/dd1931a266064f9d9c6bde1b17876d48/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:23.783759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.794894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c8987-72e7-413e-a51d-2316ab0c7deb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.857175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084e4a7-2f7b-4480-8114-07ba213978c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.857860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e4a7-2f7b-4480-8114-07ba213978c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.858148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e4a7-2f7b-4480-8114-07ba213978c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.858832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e4a7-2f7b-4480-8114-07ba213978c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.859177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084e4a7-2f7b-4480-8114-07ba213978c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.860784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084e4a7-2f7b-4480-8114-07ba213978c5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.876936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1044/2069] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:23.878111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:23.889618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9171-8ad5-4b4f-998f-172809cc5378 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:23.895390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:23.904516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.905100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.905584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] PATH_INFO: `/v3/projects/fa083081200e4abf847de1ad90de13f1/users/dd1931a266064f9d9c6bde1b17876d48/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.908113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa083081200e4abf847de1ad90de13f1, user_id=dd1931a266064f9d9c6bde1b17876d48, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:23.912238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:23.924896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1026/2070] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:23 2021] PUT /identity/v3/projects/fa083081200e4abf847de1ad90de13f1/users/dd1931a266064f9d9c6bde1b17876d48/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:23.935595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:23.935885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:23.936195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:23.967509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] MFA Rules not processed for user `dd1931a266064f9d9c6bde1b17876d48`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:23.968828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:24.057090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1045/2071] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:23 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:24.068320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:24.070079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:24.127713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af196-644e-4c91-8edb-62a22b2bba15 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:24.131793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70df2a-b4c2-44d9-aa8e-4bc852f6ff8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:24.132438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70df2a-b4c2-44d9-aa8e-4bc852f6ff8c service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:24.132721 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70df2a-b4c2-44d9-aa8e-4bc852f6ff8c service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:24.132999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70df2a-b4c2-44d9-aa8e-4bc852f6ff8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:24.142503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70df2a-b4c2-44d9-aa8e-4bc852f6ff8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:24.144474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70df2a-b4c2-44d9-aa8e-4bc852f6ff8c service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:24.154583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1027/2072] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:24 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:24.860489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:24.932103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77915b09-4365-4af8-9a8e-dc5fb3532561 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:24.944354 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:24.945716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:24.946203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:24.947208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] PATH_INFO: `/v3/users/ee017a484ded4658bd068b90245b4dc3` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:24.948717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee017a484ded4658bd068b90245b4dc3)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:24.952034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:25.171522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee017a484ded4658bd068b90245b4dc3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:25.172310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee017a484ded4658bd068b90245b4dc3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:25.242446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee017a484ded4658bd068b90245b4dc3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:25.243122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee017a484ded4658bd068b90245b4dc3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:25.258744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee017a484ded4658bd068b90245b4dc3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:25.273382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1046/2073] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:24 2021] DELETE /identity/v3/users/ee017a484ded4658bd068b90245b4dc3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:25.277772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:25.280052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:25.280052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:25.299793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:25.301214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:25.384831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1028/2074] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:25.396009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:25.397554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:25.464000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a18ce-dbb8-4544-8359-daffb7d2287b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:25.470397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:25.475273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:25.475273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:25.475273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:25.483129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:25.484757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:25.495906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1047/2075] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:26.045971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:26.047987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:26.062913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faa433-c9e8-4f21-bf4a-58acf944a301 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:26.071614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:26.072492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:26.072772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:26.073040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] PATH_INFO: `/v3/projects/4c250d3399944fbab340db9825622412` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:26.074300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c250d3399944fbab340db9825622412)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:26.078075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:26.274847 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c250d3399944fbab340db9825622412', 'request_id': 'req-58693408-7971-44eb-a3f5-a623b31a014d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.281199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c250d3399944fbab340db9825622412', 'request_id': 'req-58693408-7971-44eb-a3f5-a623b31a014d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.390643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c250d3399944fbab340db9825622412', 'request_id': 'req-58693408-7971-44eb-a3f5-a623b31a014d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.402816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] The token cache is being invalidate because project 4c250d3399944fbab340db9825622412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:26.403107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.403785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.407518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1029/2076] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:26 2021] DELETE /identity/v3/projects/4c250d3399944fbab340db9825622412 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:26.409374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:26.421603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcec027-80f9-4e7c-861d-38c754257e05 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:26.425091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:26.426216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:26.487263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:26.488978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:26.489273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:26.489556 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] PATH_INFO: `/v3/users/dd1931a266064f9d9c6bde1b17876d48` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:26.490866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1931a266064f9d9c6bde1b17876d48)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:26.492988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:26.493220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58693408-7971-44eb-a3f5-a623b31a014d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:26.499036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:26.499905 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:26.500187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:26.500464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] PATH_INFO: `/v3/users/ece4dd39d28a4934952ac41c317677ba` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:26.501674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece4dd39d28a4934952ac41c317677ba)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:26.503750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:26.713911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1931a266064f9d9c6bde1b17876d48'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.714601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1931a266064f9d9c6bde1b17876d48'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.784405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece4dd39d28a4934952ac41c317677ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.810375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1931a266064f9d9c6bde1b17876d48'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.811130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1931a266064f9d9c6bde1b17876d48'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.826586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-64ba3e3d-c262-4b2c-82f7-0c3eafd321e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1931a266064f9d9c6bde1b17876d48'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.840465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1048/2077] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:26 2021] DELETE /identity/v3/users/dd1931a266064f9d9c6bde1b17876d48 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:26.915777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece4dd39d28a4934952ac41c317677ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.924522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece4dd39d28a4934952ac41c317677ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.925312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece4dd39d28a4934952ac41c317677ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.926207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece4dd39d28a4934952ac41c317677ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:26.939020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1030/2078] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:26 2021] DELETE /identity/v3/users/ece4dd39d28a4934952ac41c317677ba => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:26.944369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:26.944757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:26.945044 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:26.964396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:26.965188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:27.025992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1049/2079] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:27.035473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:27.037080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:27.095633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbe50b-39b7-4e6a-bcca-ce8498c4d407 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:27.100301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:27.100985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:27.101271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:27.101551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:27.111357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:27.112849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:27.125692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1031/2080] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:27.449106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:27.450706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:27.466070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe512365-3a02-41e1-8245-f9052f0fae0e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:27.495076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:27.496163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:27.496546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:27.496770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] PATH_INFO: `/v3/projects/fa083081200e4abf847de1ad90de13f1` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:27.498192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa083081200e4abf847de1ad90de13f1)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:27.500884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:27.657155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa083081200e4abf847de1ad90de13f1', 'request_id': 'req-01c96c25-c6f8-429c-928f-c9048f893065'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:27.774905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa083081200e4abf847de1ad90de13f1', 'request_id': 'req-01c96c25-c6f8-429c-928f-c9048f893065'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:27.788110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa083081200e4abf847de1ad90de13f1', 'request_id': 'req-01c96c25-c6f8-429c-928f-c9048f893065'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:27.789372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:27.791122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:27.795056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] The token cache is being invalidate because project fa083081200e4abf847de1ad90de13f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:27.795345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:27.796448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01c96c25-c6f8-429c-928f-c9048f893065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:27.798143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1050/2081] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:27 2021] DELETE /identity/v3/projects/fa083081200e4abf847de1ad90de13f1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:27.811885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33809bc8-1350-4726-8c18-a9ace86e50b1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:27.812083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33809bc8-1350-4726-8c18-a9ace86e50b1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:27.812281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33809bc8-1350-4726-8c18-a9ace86e50b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:27.817819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3082d2-4d34-40af-88cd-9a97bfab2e8b service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:27.831500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-33809bc8-1350-4726-8c18-a9ace86e50b1 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:27.833255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-33809bc8-1350-4726-8c18-a9ace86e50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:27.918639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1051/2082] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:27.920043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:27.921609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:27.922218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:27.922677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] PATH_INFO: `/v3/projects/45aaa5f8ac7145c0b412b6f2ae5785d0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:27.924130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45aaa5f8ac7145c0b412b6f2ae5785d0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:27.926051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:27.931874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:27.931874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:27.932165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.094857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:28.096091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:28.105172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1052/2083] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:28.109074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.119149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e675-f411-4dc5-8fa4-c872971bff06 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.125112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45aaa5f8ac7145c0b412b6f2ae5785d0', 'request_id': 'req-1f81687a-7857-439b-9875-f59284baef85'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.134374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45aaa5f8ac7145c0b412b6f2ae5785d0', 'request_id': 'req-1f81687a-7857-439b-9875-f59284baef85'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.186856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.187526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.187899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.188176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.188958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:28.189504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.190976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.203381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1053/2084] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:05:28.208019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.217940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64948c-9c59-4cbf-8788-78cd76950b9b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.223459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.224113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.224397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.224663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.225355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.227317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.231212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45aaa5f8ac7145c0b412b6f2ae5785d0', 'request_id': 'req-1f81687a-7857-439b-9875-f59284baef85'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.243347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] The token cache is being invalidate because project 45aaa5f8ac7145c0b412b6f2ae5785d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:28.243859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.244972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.246869 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1032/2085] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:27 2021] DELETE /identity/v3/projects/45aaa5f8ac7145c0b412b6f2ae5785d0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:28.250655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.252098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:28.265336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81687a-7857-439b-9875-f59284baef85 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.271059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.271935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.272251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.272484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] PATH_INFO: `/v3/users/9dbc0c31f199486397b6569f377c633c` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.273790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbc0c31f199486397b6569f377c633c)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.275829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.361596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1054/2086] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:28 2021] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:28.367718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.367718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:28.431264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f54cf-1d64-43e0-a6af-3f17b854e320 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.436107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.436826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.437061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.437353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.438028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.439978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.617979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbc0c31f199486397b6569f377c633c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.660964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1055/2087] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:28 2021] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:28.662067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.682624 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc3ad-b48e-4aba-ba28-d164f2c3d82c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.688103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.688787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.689069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.689356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.690089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.691851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.702875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1056/2088] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:28 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:28.707978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.717403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd797-b7a6-4a8e-8889-f4fc9b37deb1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.721956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.723404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.723677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.723952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.724659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.726242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.736371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1057/2089] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:28.741101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:28.745007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbc0c31f199486397b6569f377c633c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.751104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50db5-49d8-4495-852e-8cff337fc315 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:28.756480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:28.757419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.757696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.757966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] PATH_INFO: `/v3/projects/2b261bfda9504ed680ac9b7e307e6db1/users/61c19bd465024b259ca5dba10df5b19c/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.758415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbc0c31f199486397b6569f377c633c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.759112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbc0c31f199486397b6569f377c633c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.759719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92efa24e-a7ca-431b-a6dc-31468e85e178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbc0c31f199486397b6569f377c633c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:28.773761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1033/2090] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:28 2021] DELETE /identity/v3/users/9dbc0c31f199486397b6569f377c633c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:28.789875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b261bfda9504ed680ac9b7e307e6db1, user_id=61c19bd465024b259ca5dba10df5b19c, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:28.789875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:28.922401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1058/2091] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:28 2021] PUT /identity/v3/projects/2b261bfda9504ed680ac9b7e307e6db1/users/61c19bd465024b259ca5dba10df5b19c/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:28.933658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:28.934176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:28.934478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:28.962455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] MFA Rules not processed for user `61c19bd465024b259ca5dba10df5b19c`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:28.963710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.043434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1034/2092] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:28 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:29.060256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:29.062674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.139030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72ac7b-5998-4541-981e-b275bb47af9e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:29.143137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:29.144885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.145201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.145616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.154828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:29.162733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:29.166800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1059/2093] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:29 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:29.185984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:29.187696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.253386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e345c1-2574-4396-9e67-5557bc3a45a1 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:29.259116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:29.259975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.260256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.260533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] PATH_INFO: `/v3/users/61c19bd465024b259ca5dba10df5b19c` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.261752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c19bd465024b259ca5dba10df5b19c)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:29.263702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:29.278053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:29.279614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.294015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e85d9-8ab3-4770-8af7-5c80092406c8 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:29.299262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:29.301147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.301958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.307796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] PATH_INFO: `/v3/projects/594c2340f79842b5b16c34377e6d7377` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.309028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594c2340f79842b5b16c34377e6d7377)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:29.311031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:29.503064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594c2340f79842b5b16c34377e6d7377', 'request_id': 'req-2cf808dc-ceda-4a04-a147-e7407c2884d7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.509236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c19bd465024b259ca5dba10df5b19c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.585150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594c2340f79842b5b16c34377e6d7377', 'request_id': 'req-2cf808dc-ceda-4a04-a147-e7407c2884d7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.591167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594c2340f79842b5b16c34377e6d7377', 'request_id': 'req-2cf808dc-ceda-4a04-a147-e7407c2884d7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.602391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] The token cache is being invalidate because project 594c2340f79842b5b16c34377e6d7377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:29.602730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.603409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2cf808dc-ceda-4a04-a147-e7407c2884d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.605196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1060/2094] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:29 2021] DELETE /identity/v3/projects/594c2340f79842b5b16c34377e6d7377 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:29.611168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cbc37-38c7-41d4-a362-2720050a2308 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.611449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cbc37-38c7-41d4-a362-2720050a2308 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.611725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cbc37-38c7-41d4-a362-2720050a2308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.631217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7b8cbc37-38c7-41d4-a362-2720050a2308 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:29.632440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7b8cbc37-38c7-41d4-a362-2720050a2308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.651379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c19bd465024b259ca5dba10df5b19c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.662485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c19bd465024b259ca5dba10df5b19c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.663228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c19bd465024b259ca5dba10df5b19c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.663843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-8a491ccd-b798-4b85-8251-061a56864623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c19bd465024b259ca5dba10df5b19c'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:29.677573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1035/2095] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:29 2021] DELETE /identity/v3/users/61c19bd465024b259ca5dba10df5b19c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:29.681839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.682280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.682658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.700241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1061/2096] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:29.702878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:29.704337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.711423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.712144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.712533 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.745275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:29.746949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.802600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1036/2097] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:29.811138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:29.817303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:29.832121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1062/2098] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:29.839008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:29.849421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c100-646a-4fc2-9dba-f267e3ec3ee6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:29.854505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:29.855208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.856217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.856217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.856464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:29.856776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:29.858477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:29.871514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1063/2099] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:29.875861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:29.878992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f35d9-7e6b-4053-b8da-11b7d47a2e0a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:29.886152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:29.886152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.886152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.886152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.895956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:29.897443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:29.902517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174148ec-c375-4e3e-bfb5-fba83aa3854d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:29.908858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:29.909226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1037/2100] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:29.911111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:29.911593 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:29.911939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:29.912588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:29.914661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.042732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1064/2101] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:29 2021] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:30.049008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.060538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb51f0-7e10-4154-b3a4-27751b868187 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.062160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.064072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.152852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.153688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.153878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.154367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.155324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.157580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.163036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b916dc-9ae0-4921-b759-1acf3e9823ac admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.170310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.171507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.171850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.172127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] PATH_INFO: `/v3/users/231b6ac082164da799a03c79d66fe048` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.180431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=231b6ac082164da799a03c79d66fe048)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.180431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.279737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1038/2102] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:30 2021] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:30.284595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.314868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3ef7-d39d-4846-917c-5db28c994382 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.320860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.321551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.321833 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.322203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.322995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.324603 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.342027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1039/2103] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:30.343985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.354917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a60d-fef3-4139-8f42-715864ed445f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.359819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.360500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.360839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.361170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.361901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.363564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.379503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1040/2104] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:30.383719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.393943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015adda-1ade-48f9-927d-adef58b9dfe9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.410209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.410209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.410209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.410209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] PATH_INFO: `/v3/projects/43ccefac7f3746c68214be66026da43d/users/0c8e2b8a0f3f49f4a3e20160ec0b0193/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.426435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ccefac7f3746c68214be66026da43d, user_id=0c8e2b8a0f3f49f4a3e20160ec0b0193, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.429393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.459172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231b6ac082164da799a03c79d66fe048'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.460394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231b6ac082164da799a03c79d66fe048'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.524306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1041/2105] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:30 2021] PUT /identity/v3/projects/43ccefac7f3746c68214be66026da43d/users/0c8e2b8a0f3f49f4a3e20160ec0b0193/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:30.525651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.526870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.591563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665490fc-ff60-48fa-861b-306581b4cce8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.596469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.596630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231b6ac082164da799a03c79d66fe048'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.597334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.597646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.597823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231b6ac082164da799a03c79d66fe048'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.597913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] PATH_INFO: `/v3/projects/2b261bfda9504ed680ac9b7e307e6db1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.599215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b261bfda9504ed680ac9b7e307e6db1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.601335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.612985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ad7dbbec-1272-4dcb-8a32-739285a9eaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231b6ac082164da799a03c79d66fe048'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.627411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1065/2106] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:30 2021] DELETE /identity/v3/users/231b6ac082164da799a03c79d66fe048 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:30.630948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7381ad-c3f6-4c4f-8f41-ff103cb69045 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.632008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7381ad-c3f6-4c4f-8f41-ff103cb69045 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.632490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7381ad-c3f6-4c4f-8f41-ff103cb69045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.651115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8d7381ad-c3f6-4c4f-8f41-ff103cb69045 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:30.652356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8d7381ad-c3f6-4c4f-8f41-ff103cb69045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.719651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1066/2107] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:30.721055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.721345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.721629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.743360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:30.749441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.758127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b261bfda9504ed680ac9b7e307e6db1', 'request_id': 'req-305b52c2-8419-4762-9689-9c5a454313dc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.767508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b261bfda9504ed680ac9b7e307e6db1', 'request_id': 'req-305b52c2-8419-4762-9689-9c5a454313dc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.813021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1067/2108] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:30.813917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.815295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.882314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b261bfda9504ed680ac9b7e307e6db1', 'request_id': 'req-305b52c2-8419-4762-9689-9c5a454313dc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.882830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af84de-ab61-409e-b42b-c5ccdd5664de None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.887104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d08cb0-f0be-4dae-95d4-2532fb584190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.887771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d08cb0-f0be-4dae-95d4-2532fb584190 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.888051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d08cb0-f0be-4dae-95d4-2532fb584190 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.888330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d08cb0-f0be-4dae-95d4-2532fb584190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.900781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] The token cache is being invalidate because project 2b261bfda9504ed680ac9b7e307e6db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:30.902004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.902103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d08cb0-f0be-4dae-95d4-2532fb584190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.902952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:30.904193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d08cb0-f0be-4dae-95d4-2532fb584190 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:30.905038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1042/2109] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:30 2021] DELETE /identity/v3/projects/2b261bfda9504ed680ac9b7e307e6db1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:30.911369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:30.912890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.919948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1068/2110] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:30.921798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706f230-4954-48e4-b5a7-8bf7d551d3f6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.922046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706f230-4954-48e4-b5a7-8bf7d551d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.922451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706f230-4954-48e4-b5a7-8bf7d551d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.949376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e706f230-4954-48e4-b5a7-8bf7d551d3f6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:30.950943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b52c2-8419-4762-9689-9c5a454313dc admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:30.951121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e706f230-4954-48e4-b5a7-8bf7d551d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.960947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1069/2111] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:30.968876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:30.969659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.970014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.970360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.971384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:30.972126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:30.973459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:30.974043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:30.990207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:30.992382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.001102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:31.002778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:31.004314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1043/2112] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:31.013535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1070/2113] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:31.025228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.031510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635911d1-808f-424e-8b2a-52ebca61346f service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.039655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.040437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.040842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.041207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.042265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:31.042836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.044711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.067119 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1044/2114] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:31.069574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.080463 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b9e89-efa9-423e-ae79-aa6321c82d69 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.086891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.087603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.088020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.088252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.088957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.090974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.212345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1071/2115] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:31 2021] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:31.216578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.227121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a8b26-3dc2-4b7d-96bd-9ea908bb8747 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.291233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.291969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.292260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.292536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.293238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.295240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.453080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1045/2116] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:31 2021] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:31.457588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.468494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8afe2-a282-4650-970e-d1a0880c1d9b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.473915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.474639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.474934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.475216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.475957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.477692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.492602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1072/2117] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:31.496945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.514801 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8f1dd-d9f1-4793-871c-3a825e928562 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.524788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.525560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.525853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.526185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.526967 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.528757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.541766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1046/2118] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:31.545990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.565791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908098dc-7500-40c0-ae06-8e552f1f49bc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.565791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.565791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.565791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.566876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] PATH_INFO: `/v3/projects/37d40034441a410490e120eb9f969d88/users/5e3ef2ee8ecd49b5a8eb63a246843fbc/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.583771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d40034441a410490e120eb9f969d88, user_id=5e3ef2ee8ecd49b5a8eb63a246843fbc, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.586706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.649181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.650677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:31.664122 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17a259-6af9-4849-b4ff-334f8e290de7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.668880 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.669754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.670036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.670311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] PATH_INFO: `/v3/users/b86e53e0b9a24b9f95a8b9ee61a35f30` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.674814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86e53e0b9a24b9f95a8b9ee61a35f30)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.674814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.741743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1073/2119] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:31 2021] PUT /identity/v3/projects/37d40034441a410490e120eb9f969d88/users/5e3ef2ee8ecd49b5a8eb63a246843fbc/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:31.742609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:31.744781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:31.807488 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb13a-0848-41ce-b445-162c343159f5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:31.812262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:31.813119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:31.813400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:31.813671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] PATH_INFO: `/v3/projects/9b5c34642e104d708150f0365e4ca888` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:31.814881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5c34642e104d708150f0365e4ca888)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:31.817030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:31.926666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86e53e0b9a24b9f95a8b9ee61a35f30'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.070809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5c34642e104d708150f0365e4ca888', 'request_id': 'req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.077078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86e53e0b9a24b9f95a8b9ee61a35f30'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.092296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86e53e0b9a24b9f95a8b9ee61a35f30'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.093208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86e53e0b9a24b9f95a8b9ee61a35f30'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.093886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e8d13ef9-a1e7-4484-bfc6-ed0e9953a34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86e53e0b9a24b9f95a8b9ee61a35f30'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.106881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1047/2120] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:31 2021] DELETE /identity/v3/users/b86e53e0b9a24b9f95a8b9ee61a35f30 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:32.108755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:32.110209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:32.110209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:32.137351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] MFA Rules not processed for user `5e3ef2ee8ecd49b5a8eb63a246843fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:32.138577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:32.151283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5c34642e104d708150f0365e4ca888', 'request_id': 'req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.158411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5c34642e104d708150f0365e4ca888', 'request_id': 'req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.172279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] The token cache is being invalidate because project 9b5c34642e104d708150f0365e4ca888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:32.173544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.177027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c19e15bc-597a-4cc7-8ca7-1ee26ccc30ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.178239 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1074/2121] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:31 2021] DELETE /identity/v3/projects/9b5c34642e104d708150f0365e4ca888 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:32.179724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:32.180067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:32.180348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:32.203287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:32.205188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:32.229655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1048/2122] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:32.230705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:32.232141 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:32.282747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1075/2123] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:32.283613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:32.285643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:32.308267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012e04-883c-48f3-bc51-68a97d08a052 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:32.313500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:32.314601 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:32.314905 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:32.315273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] PATH_INFO: `/v3/users/2f17f3974b154c1b862aa23e786b6509` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:32.317316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f17f3974b154c1b862aa23e786b6509)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:32.319575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:32.354822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687e4dd-39e4-42b2-87cf-3b3a2096c3c2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:32.359146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:32.359889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:32.360121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:32.360468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:32.370373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:32.371969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:32.381566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1076/2124] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:32 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:32.382379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:32.383766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:32.444261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765efdb-ee34-4d14-ad81-6818bdbbd454 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:32.448113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:32.448792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:32.449104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:32.449381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:32.461411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:32.463153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:32.477300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1077/2125] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:32.542888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f17f3974b154c1b862aa23e786b6509'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.608346 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f17f3974b154c1b862aa23e786b6509'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.623547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f17f3974b154c1b862aa23e786b6509'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.624286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f17f3974b154c1b862aa23e786b6509'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.624896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f17f3974b154c1b862aa23e786b6509'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:32.643321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1049/2126] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:32 2021] DELETE /identity/v3/users/2f17f3974b154c1b862aa23e786b6509 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:33.208849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:33.208849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:33.218726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f7de-2920-44ef-a6d0-88a2e739e22f service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:33.293123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:33.294002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:33.294600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:33.294600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] PATH_INFO: `/v3/projects/a5e3353fe1114fdfb586f83b6c29fd51` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:33.295829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e3353fe1114fdfb586f83b6c29fd51)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:33.298294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:33.420303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e3353fe1114fdfb586f83b6c29fd51', 'request_id': 'req-ce6e9328-5aad-447f-9208-d439a0268606'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.474138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:33.476900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:33.496517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04307a-df20-4db8-88be-f913b24b9a2d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:33.522203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e3353fe1114fdfb586f83b6c29fd51', 'request_id': 'req-ce6e9328-5aad-447f-9208-d439a0268606'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.528836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e3353fe1114fdfb586f83b6c29fd51', 'request_id': 'req-ce6e9328-5aad-447f-9208-d439a0268606'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.543943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] The token cache is being invalidate because project a5e3353fe1114fdfb586f83b6c29fd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:33.544443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.545322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ce6e9328-5aad-447f-9208-d439a0268606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.547372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1078/2127] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:33 2021] DELETE /identity/v3/projects/a5e3353fe1114fdfb586f83b6c29fd51 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:33.553675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aca46-2808-4a7b-8986-106e990e43ac None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:33.554609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aca46-2808-4a7b-8986-106e990e43ac None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:33.555483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aca46-2808-4a7b-8986-106e990e43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:33.564711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:33.565545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:33.566440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:33.566678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] PATH_INFO: `/v3/projects/ef22ee6ec3414624888b2a0c2080b6f8` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:33.568359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef22ee6ec3414624888b2a0c2080b6f8)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:33.570436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:33.580689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-987aca46-2808-4a7b-8986-106e990e43ac None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:33.582859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-987aca46-2808-4a7b-8986-106e990e43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:33.591943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1079/2128] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:33.600591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:33.600877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:33.601153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:33.619779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:33.620987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:33.630019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1080/2129] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:33.634098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:33.643535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb1637-269a-4e20-8b5f-bb4d5563d4ca None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:33.649376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:33.650050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:33.650344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:33.650676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:33.651524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:33.651711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:33.653386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:33.665886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1081/2130] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:05:33.673638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:33.685013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0d9c-0e64-437b-a11e-9511e36f2eec admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:33.689723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:33.690501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:33.690814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:33.691839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:33.692668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:33.694601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:33.750246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef22ee6ec3414624888b2a0c2080b6f8', 'request_id': 'req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.759499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef22ee6ec3414624888b2a0c2080b6f8', 'request_id': 'req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:33.998594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1082/2131] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:33 2021] POST /identity/v3/projects => generated 397 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:34.002425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.076735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c242-eb9e-4f3a-871c-84cb9279e28e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.084095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.084789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.085169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.085315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.086359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.088663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.225951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef22ee6ec3414624888b2a0c2080b6f8', 'request_id': 'req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:34.242828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1083/2132] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:34 2021] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:34.243903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.267616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbaef-5733-4a9c-84f4-1f6a51e17d3e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.268553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] The token cache is being invalidate because project ef22ee6ec3414624888b2a0c2080b6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:34.268860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:34.270444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0e524232-4c54-4125-8f4c-bdc2f84fe2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:34.272544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1050/2133] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:33 2021] DELETE /identity/v3/projects/ef22ee6ec3414624888b2a0c2080b6f8 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:34.278464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30354-10a6-46b7-964f-8d2dcb568c70 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.278870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30354-10a6-46b7-964f-8d2dcb568c70 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.279169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30354-10a6-46b7-964f-8d2dcb568c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.282077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.283003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.283379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.283848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.285055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.288146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.308923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1084/2134] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:34.312260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.314991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:34.322495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-94f30354-10a6-46b7-964f-8d2dcb568c70 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:34.327630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-94f30354-10a6-46b7-964f-8d2dcb568c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:34.340231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1051/2135] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:34.341732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.342033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.342311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.342501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f023c8d-f9ad-4753-be0c-bdf4adb3cbd0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.350703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.351852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.355377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.355977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.356630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.358244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.367958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:34.369232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:34.372270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1085/2136] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:34.377389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.385076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1052/2137] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:34.386065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.393251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14728c2a-68c9-4df3-bfd1-5d1fbb5df251 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.396576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6f602-1efc-4331-9f0b-2929ef9d741e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.401775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.402452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.402785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.403064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.404126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:34.404441 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.405410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664cfd-e8ef-495b-84d8-b67550cc4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.406267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.407247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664cfd-e8ef-495b-84d8-b67550cc4ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.408277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664cfd-e8ef-495b-84d8-b67550cc4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.408779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664cfd-e8ef-495b-84d8-b67550cc4ddb admin admin] PATH_INFO: `/v3/projects/3324f821a61944f9b1044eead4894fd9/users/cfe35e25f442481d8c2a9d3b1529f314/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.420320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1053/2138] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:34.426093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.451612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352edd4-4aa2-4ace-9fe6-62186cf7fe8d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.460426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b664cfd-e8ef-495b-84d8-b67550cc4ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3324f821a61944f9b1044eead4894fd9, user_id=cfe35e25f442481d8c2a9d3b1529f314, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.463303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b664cfd-e8ef-495b-84d8-b67550cc4ddb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.468762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.469853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.470138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.470433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.471201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.473292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.645876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1086/2139] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:34 2021] PUT /identity/v3/projects/3324f821a61944f9b1044eead4894fd9/users/cfe35e25f442481d8c2a9d3b1529f314/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:34.657735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.658978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.659275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.666460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1054/2140] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:34 2021] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:34.668001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.692992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] MFA Rules not processed for user `cfe35e25f442481d8c2a9d3b1529f314`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:34.694212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:34.735771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e482-a713-4d46-abe1-a2b8ef400b15 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.741769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.742684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.742830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.743045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.743741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.745788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.756911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1087/2141] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:34 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:34.767437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.768835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:34.839893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c5ea6-fb88-40fb-9a65-a3d838fbf380 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.847748 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.850846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.850846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.850846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.851144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1055/2142] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:34 2021] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:34.854772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.868179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c74d-e817-40f7-a1f6-0e6e93babd7b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.873730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.874463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.874792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.875219 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.875966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.877572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.880720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.882201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.889889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1056/2143] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:34.894891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.903482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1088/2144] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:34 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:05:34.906358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af9389-6a58-40e7-9225-2e1a25cb315c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.928547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06c8a3-010e-4d94-bc17-51095c8c8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.929247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c8a3-010e-4d94-bc17-51095c8c8852 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.929936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c8a3-010e-4d94-bc17-51095c8c8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.930232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c8a3-010e-4d94-bc17-51095c8c8852 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:34.931510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06c8a3-010e-4d94-bc17-51095c8c8852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:34.933698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06c8a3-010e-4d94-bc17-51095c8c8852 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:34.949340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1057/2145] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:34.950466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:34.962124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01adf-888f-4a67-a045-312b93bc1ec3 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:34.967246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:34.968174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:34.968470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:34.970609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] PATH_INFO: `/v3/projects/c0db604c73304e78be69d2080bc7b04d/users/55bc1adc6f494de5bca436849b841ee7/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:35.008594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0db604c73304e78be69d2080bc7b04d, user_id=55bc1adc6f494de5bca436849b841ee7, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:35.011449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:35.154296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1089/2146] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:34 2021] PUT /identity/v3/projects/c0db604c73304e78be69d2080bc7b04d/users/55bc1adc6f494de5bca436849b841ee7/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:35.168573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba402-dd6c-433f-8412-0be137fddd47 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:35.168870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba402-dd6c-433f-8412-0be137fddd47 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:35.169153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba402-dd6c-433f-8412-0be137fddd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:35.204073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-1e9ba402-dd6c-433f-8412-0be137fddd47 None None] MFA Rules not processed for user `55bc1adc6f494de5bca436849b841ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:35.205697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1e9ba402-dd6c-433f-8412-0be137fddd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:35.302819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1058/2147] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:35 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:35.931945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:35.933675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:35.995108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69541-af74-41ce-b57d-992d894427bd admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:36.000822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:36.001590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:36.001975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:36.002227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:36.015203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:36.017414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:36.052017 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1090/2148] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:35 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:38.292832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:38.293301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:38.293378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:38.326283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] MFA Rules not processed for user `0c8e2b8a0f3f49f4a3e20160ec0b0193`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:38.327573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:38.405526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1059/2149] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:38 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:38.410232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:38.411699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:38.489083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae168-597c-4039-978d-926ae34ca21b service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:38.494621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:38.495401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:38.495696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:38.495974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:38.496689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:38.498814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:38.629844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1091/2150] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:38 2021] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:38.633828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:38.646405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f06cb-f139-43f8-bbd0-410aaa6b81b9 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:38.719579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:38.720538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:38.721139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:38.721879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:38.723780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:38.727114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:38.883332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1060/2151] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:38 2021] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:05:38.888919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:38.900387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a0f28-78dd-4510-9fff-3b9b36deee4b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:38.905758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:38.906432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:38.906756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:38.908157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:38.908157 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:38.909427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:38.926474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1092/2152] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:05:38.928595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:38.941429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa6c2d-ac65-410c-858d-875180dc5d28 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:38.947952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:38.948963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:38.949522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:38.949874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] PATH_INFO: `/v3/projects/9edf0e56c7d440b0845f017b93a19da0/users/85acbeb120214833aa161e0bcefa7941/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:38.968248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edf0e56c7d440b0845f017b93a19da0, user_id=85acbeb120214833aa161e0bcefa7941, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:38.971085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:39.105259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1061/2153] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:38 2021] PUT /identity/v3/projects/9edf0e56c7d440b0845f017b93a19da0/users/85acbeb120214833aa161e0bcefa7941/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:39.109809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:39.121808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891f8f-b284-48ea-869e-1b122afd9333 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:39.182712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47f4e6-c8a1-4c6c-a03a-72705bfceae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:39.183397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47f4e6-c8a1-4c6c-a03a-72705bfceae7 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:39.183678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47f4e6-c8a1-4c6c-a03a-72705bfceae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:39.183956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47f4e6-c8a1-4c6c-a03a-72705bfceae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:39.184707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47f4e6-c8a1-4c6c-a03a-72705bfceae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:39.186282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47f4e6-c8a1-4c6c-a03a-72705bfceae7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:39.199693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1093/2154] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:39 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:39.200990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:39.214272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e93a46-a9ba-4958-9a58-a5f732bcec19 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:39.219161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:39.220051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:39.220335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:39.220610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] PATH_INFO: `/v3/projects/9edf0e56c7d440b0845f017b93a19da0/users/85acbeb120214833aa161e0bcefa7941/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:39.222645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edf0e56c7d440b0845f017b93a19da0, user_id=85acbeb120214833aa161e0bcefa7941, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:39.226067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:39.236807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1062/2155] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:39 2021] PUT /identity/v3/projects/9edf0e56c7d440b0845f017b93a19da0/users/85acbeb120214833aa161e0bcefa7941/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:46.155907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d7801-ddc0-4737-b2dc-f40ca8b24b71 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:46.156526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d7801-ddc0-4737-b2dc-f40ca8b24b71 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:46.156526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d7801-ddc0-4737-b2dc-f40ca8b24b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:46.189656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-791d7801-ddc0-4737-b2dc-f40ca8b24b71 None None] MFA Rules not processed for user `85acbeb120214833aa161e0bcefa7941`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:46.191244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-791d7801-ddc0-4737-b2dc-f40ca8b24b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:46.276282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1094/2156] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:46 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:46.289422 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:46.291335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:46.382320 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bd35e-59e8-4e6b-aa2f-5ec17a0fd3bd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:46.388028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:46.388688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:46.388972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:46.389251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:46.444335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:46.445930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:46.454753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1063/2157] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:46 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:49.689803 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2d94d-5f6c-426a-a9ec-b63cff020b81 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:49.690365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2d94d-5f6c-426a-a9ec-b63cff020b81 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:49.690365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2d94d-5f6c-426a-a9ec-b63cff020b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:49.711941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-27c2d94d-5f6c-426a-a9ec-b63cff020b81 None None] MFA Rules not processed for user `0c8e2b8a0f3f49f4a3e20160ec0b0193`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:49.713178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-27c2d94d-5f6c-426a-a9ec-b63cff020b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:49.720582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1095/2158] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:49 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:53.214391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:53.303906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8afdc4-da6d-43e3-a3d8-66b6c90522ff service nova] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:53.309402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:53.310332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:53.310842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:53.311689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] PATH_INFO: `/v3/users/cfe35e25f442481d8c2a9d3b1529f314` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:53.313317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe35e25f442481d8c2a9d3b1529f314)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:53.316848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:53.569056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe35e25f442481d8c2a9d3b1529f314'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:53.647917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe35e25f442481d8c2a9d3b1529f314'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:53.664984 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe35e25f442481d8c2a9d3b1529f314'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:53.665804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe35e25f442481d8c2a9d3b1529f314'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:53.666473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe35e25f442481d8c2a9d3b1529f314'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:53.680444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1064/2159] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:53 2021] DELETE /identity/v3/users/cfe35e25f442481d8c2a9d3b1529f314 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:53.685545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:53.686078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:53.686078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:53.707736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:53.709450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:53.776687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1096/2160] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:53.790978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:53.792630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:53.870152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c533-f2fa-49a5-9ef5-bdc55aa17b07 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:53.874108 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:53.874887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:53.875238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:53.875595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:53.887013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:53.889206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:53.906265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1065/2161] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:54.655337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:54.655337 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:54.683161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc325-834a-4edc-a418-0052ac40dee3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:54.683161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:54.683161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:54.683161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:54.683650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] PATH_INFO: `/v3/projects/3324f821a61944f9b1044eead4894fd9` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:54.683650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3324f821a61944f9b1044eead4894fd9)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:54.683650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:54.809767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3324f821a61944f9b1044eead4894fd9', 'request_id': 'req-ff136a33-30d1-4791-9443-14d56f716f8d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:54.911628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3324f821a61944f9b1044eead4894fd9', 'request_id': 'req-ff136a33-30d1-4791-9443-14d56f716f8d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:54.918268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3324f821a61944f9b1044eead4894fd9', 'request_id': 'req-ff136a33-30d1-4791-9443-14d56f716f8d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:54.930472 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] The token cache is being invalidate because project 3324f821a61944f9b1044eead4894fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:54.930808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:54.931458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ff136a33-30d1-4791-9443-14d56f716f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:54.933046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1097/2162] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:54 2021] DELETE /identity/v3/projects/3324f821a61944f9b1044eead4894fd9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:56.590780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:56.594304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:56.606132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1d85-ca60-486d-8804-336047791679 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:56.666720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:56.667599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:56.667881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:56.668160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] PATH_INFO: `/v3/users/55bc1adc6f494de5bca436849b841ee7` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:56.669397 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bc1adc6f494de5bca436849b841ee7)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:56.671357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:56.964648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bc1adc6f494de5bca436849b841ee7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.037032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bc1adc6f494de5bca436849b841ee7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.050421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bc1adc6f494de5bca436849b841ee7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.051714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bc1adc6f494de5bca436849b841ee7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.052398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bc1adc6f494de5bca436849b841ee7'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.066954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1066/2163] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:56 2021] DELETE /identity/v3/users/55bc1adc6f494de5bca436849b841ee7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:57.071502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:57.072164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:57.072164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:57.090280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:57.091448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:57.155253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1098/2164] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:57.166230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:57.167822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:57.228305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9303ccb-3c31-4512-a788-c761a8c3c105 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:57.236915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653905d-70c6-4c49-8adb-f267ed03798f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:57.237604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653905d-70c6-4c49-8adb-f267ed03798f service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:57.237890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653905d-70c6-4c49-8adb-f267ed03798f service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:57.238218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653905d-70c6-4c49-8adb-f267ed03798f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:57.250858 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653905d-70c6-4c49-8adb-f267ed03798f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:57.252666 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653905d-70c6-4c49-8adb-f267ed03798f service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:57.274029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1067/2165] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:57.718609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:57.720863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:57.732997 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade7e24-2d6c-4348-95d7-38fc3495a422 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:57.737711 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:57.739283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:57.740095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:57.740095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] PATH_INFO: `/v3/projects/c0db604c73304e78be69d2080bc7b04d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:57.741384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0db604c73304e78be69d2080bc7b04d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:57.743331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:57.860034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0db604c73304e78be69d2080bc7b04d', 'request_id': 'req-4ba53508-9390-4450-be73-41adbd213e55'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.973899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0db604c73304e78be69d2080bc7b04d', 'request_id': 'req-4ba53508-9390-4450-be73-41adbd213e55'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.983935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0db604c73304e78be69d2080bc7b04d', 'request_id': 'req-4ba53508-9390-4450-be73-41adbd213e55'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.993469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] The token cache is being invalidate because project c0db604c73304e78be69d2080bc7b04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:05:57.993759 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.994430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4ba53508-9390-4450-be73-41adbd213e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:05:57.996291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1099/2166] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:05:57 2021] DELETE /identity/v3/projects/c0db604c73304e78be69d2080bc7b04d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:05:58.003508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.004640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.004993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.034317 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:58.036198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:58.098356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1068/2167] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:58.107107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.107651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.107651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.126522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:58.127732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:58.136518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1100/2168] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:05:58.140903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.151005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed7a78-05c0-4186-8637-24771ba8bbc4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:58.155677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:58.156419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.156705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.156988 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.157752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:05:58.158060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:58.159713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:58.172383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1069/2169] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:05:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:05:58.177952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.187990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15521f3d-e4da-4700-a57c-8114b36074a0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:58.193411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:58.194082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.194429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.194665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.195353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:58.197242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:58.322654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1101/2170] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:05:58 2021] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:58.323815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.334709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce0cbf-6daa-4506-b6b9-0b150319e3d1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:58.406224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:58.406934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.407237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.407514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.408197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:58.410667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:58.534548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1070/2171] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:05:58 2021] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:05:58.540986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.551448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866346-985d-4ed2-a7ef-2026a31d70d0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:58.556280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:58.556999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.557277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.557551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.558266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:58.559888 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:58.571036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1102/2172] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:58.575275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.587137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf49bc0-5ec7-4269-9f25-e8634f1a18b2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:58.592116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70605e-87b5-4374-a4ba-c2491d292351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:58.592794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70605e-87b5-4374-a4ba-c2491d292351 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.593079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70605e-87b5-4374-a4ba-c2491d292351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.593358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70605e-87b5-4374-a4ba-c2491d292351 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.594086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70605e-87b5-4374-a4ba-c2491d292351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:58.595796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70605e-87b5-4374-a4ba-c2491d292351 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:58.607876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1071/2173] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:05:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:05:58.611539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.621854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13fac-c9bd-458e-ac02-69b7f3c42b7e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:58.626922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:58.627829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.628108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.628389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] PATH_INFO: `/v3/projects/bfb3a8a05e4c47748a9b68ab19f809b3/users/2d19d9ec20ee4b1aa347359539a697f2/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.644912 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb3a8a05e4c47748a9b68ab19f809b3, user_id=2d19d9ec20ee4b1aa347359539a697f2, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:58.647795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:58.808643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1103/2174] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:05:58 2021] PUT /identity/v3/projects/bfb3a8a05e4c47748a9b68ab19f809b3/users/2d19d9ec20ee4b1aa347359539a697f2/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:05:58.819117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:58.819406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:58.819683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:58.848741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] MFA Rules not processed for user `2d19d9ec20ee4b1aa347359539a697f2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:05:58.849963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:58.912620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1072/2175] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:05:58 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:05:58.923704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:58.928624 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:59.007238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2b0b-da66-4dce-83ef-851a653d4a52 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:59.011260 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da75bf5-4547-4cb7-ae2d-32809e02d0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:59.011965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75bf5-4547-4cb7-ae2d-32809e02d0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:59.012257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75bf5-4547-4cb7-ae2d-32809e02d0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:59.012537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75bf5-4547-4cb7-ae2d-32809e02d0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:59.022952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da75bf5-4547-4cb7-ae2d-32809e02d0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:59.024384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da75bf5-4547-4cb7-ae2d-32809e02d0c0 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:05:59.033452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1104/2176] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:05:58 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:05:59.753237 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:05:59.757834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:05:59.823804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14583a-cdf1-4efc-b78a-d731f3333bde None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:05:59.828536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:05:59.829445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:05:59.829692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:05:59.829965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] PATH_INFO: `/v3/users/5e3ef2ee8ecd49b5a8eb63a246843fbc` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:05:59.831174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3ef2ee8ecd49b5a8eb63a246843fbc)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:05:59.833133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:00.080654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3ef2ee8ecd49b5a8eb63a246843fbc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:00.173843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3ef2ee8ecd49b5a8eb63a246843fbc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:00.187156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3ef2ee8ecd49b5a8eb63a246843fbc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:00.187859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3ef2ee8ecd49b5a8eb63a246843fbc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:00.188466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3ef2ee8ecd49b5a8eb63a246843fbc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:00.203898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1073/2177] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:05:59 2021] DELETE /identity/v3/users/5e3ef2ee8ecd49b5a8eb63a246843fbc => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:00.209947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:00.210466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:00.210466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:00.239351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:00.240728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:00.306786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1105/2178] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:00.318043 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:00.319574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:00.376058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446a762-7a8c-444d-b62f-b1a72fc04a70 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:00.380171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aec2d-bca9-4705-a200-f8e3380e6c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:00.380991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aec2d-bca9-4705-a200-f8e3380e6c6f service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:00.381275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aec2d-bca9-4705-a200-f8e3380e6c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:00.381547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aec2d-bca9-4705-a200-f8e3380e6c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:00.390968 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1aec2d-bca9-4705-a200-f8e3380e6c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:00.392415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1aec2d-bca9-4705-a200-f8e3380e6c6f service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:00.403783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1074/2179] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:06:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:06:00.924144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:00.925549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:00.938292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4c250-4dcd-478f-84e3-2f9855568eef None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:00.945875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:00.946775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:00.947052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:00.947323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] PATH_INFO: `/v3/projects/37d40034441a410490e120eb9f969d88` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:00.948545 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d40034441a410490e120eb9f969d88)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:00.950522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.081151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d40034441a410490e120eb9f969d88', 'request_id': 'req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:01.187349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d40034441a410490e120eb9f969d88', 'request_id': 'req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:01.193552 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d40034441a410490e120eb9f969d88', 'request_id': 'req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:01.207113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] The token cache is being invalidate because project 37d40034441a410490e120eb9f969d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:06:01.207508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:01.208973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1bdbe981-a5ed-43cf-9b54-a7a189ea744d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:01.210769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1106/2180] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:06:00 2021] DELETE /identity/v3/projects/37d40034441a410490e120eb9f969d88 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:01.217214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.219764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.219764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.245896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:01.247248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:01.314338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1075/2181] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:01.323176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.323176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.323438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.348584 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:01.349795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:01.362186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1107/2182] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:01.363564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:01.375307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b573cd-71de-444b-8be2-4f1cd2ab3eca None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:01.381033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:01.381762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.382129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.382737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.383411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:06:01.383790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:01.385418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.397691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1076/2183] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:06:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:06:01.401884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:01.412310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb86ed-43dc-4c08-95eb-96fd034caf7c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:01.417497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:01.418376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.419081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.419342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.420058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:01.422308 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.530052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1108/2184] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:06:01 2021] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:06:01.534246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:01.546428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932fd10-2010-41b1-8f48-4f86bc8d53c9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:01.616629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:01.617822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.617822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.618278 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.618816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:01.620761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.737286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1077/2185] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:06:01 2021] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:06:01.738834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:01.749564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ec7c2-8c0e-45a1-89e7-03b3405e8e19 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:01.754238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:01.755443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.755443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.758944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.758944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:01.758944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.773845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1109/2186] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:06:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:06:01.775137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:01.785426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fd189-89b6-4af9-ac83-9fc22642dab5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:01.792585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df3ea5-15a1-4243-adf2-ea38df4d123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:01.793255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3ea5-15a1-4243-adf2-ea38df4d123e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.793629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3ea5-15a1-4243-adf2-ea38df4d123e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.793911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3ea5-15a1-4243-adf2-ea38df4d123e admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.794684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df3ea5-15a1-4243-adf2-ea38df4d123e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:01.796324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df3ea5-15a1-4243-adf2-ea38df4d123e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.807786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1078/2187] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:06:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:06:01.811962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:01.822914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbdfd-bd41-4dac-985e-181b979fd6d9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:01.829234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:01.830207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.830486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.830791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] PATH_INFO: `/v3/projects/5eea3b6745c74cddaf1a5482f89f0a30/users/26ed44e041fd4d9bb742562ae15c8717/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:01.847506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eea3b6745c74cddaf1a5482f89f0a30, user_id=26ed44e041fd4d9bb742562ae15c8717, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:01.852777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:01.967276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1110/2188] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:06:01 2021] PUT /identity/v3/projects/5eea3b6745c74cddaf1a5482f89f0a30/users/26ed44e041fd4d9bb742562ae15c8717/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:01.981373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907069a-e57a-4932-9509-2c7564df3149 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:01.981661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907069a-e57a-4932-9509-2c7564df3149 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:01.981937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907069a-e57a-4932-9509-2c7564df3149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:02.014329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f907069a-e57a-4932-9509-2c7564df3149 None None] MFA Rules not processed for user `26ed44e041fd4d9bb742562ae15c8717`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:02.015582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f907069a-e57a-4932-9509-2c7564df3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:02.083474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1079/2189] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:01 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:02.093663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:02.095560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:02.161973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d709d-890b-4a2e-b8e8-ba908592913f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:02.165930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:02.166703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:02.167062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:02.167419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:02.177618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:02.180572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:02.189429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1111/2190] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:06:02 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:06:03.184132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871e751-58e9-4382-9c56-167f9ba63a7c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:03.184647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871e751-58e9-4382-9c56-167f9ba63a7c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:03.184830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871e751-58e9-4382-9c56-167f9ba63a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:03.208744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2871e751-58e9-4382-9c56-167f9ba63a7c None None] MFA Rules not processed for user `a21ac4ce459d4eee9f73d4c7207968b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:03.210223 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2871e751-58e9-4382-9c56-167f9ba63a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:03.282965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1080/2191] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:03 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:06:42.140994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:42.205878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116d00-12cd-476a-97a0-5994c1878062 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:42.210790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:42.211477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:42.211605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:42.211847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] PATH_INFO: `/v3/users/26ed44e041fd4d9bb742562ae15c8717` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:42.213021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ed44e041fd4d9bb742562ae15c8717)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:42.215020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:42.393106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ed44e041fd4d9bb742562ae15c8717'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:42.393732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ed44e041fd4d9bb742562ae15c8717'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:42.466395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ed44e041fd4d9bb742562ae15c8717'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:42.467142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ed44e041fd4d9bb742562ae15c8717'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:42.479903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ed44e041fd4d9bb742562ae15c8717'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:42.491922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1112/2192] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:06:42 2021] DELETE /identity/v3/users/26ed44e041fd4d9bb742562ae15c8717 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:42.496850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:42.497439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:42.497439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:42.516083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:42.517300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:42.587504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1081/2193] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:06:42.597970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:42.599439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:42.665966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab433-de34-45c4-b73a-ecca23423b27 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:42.670702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616087b-243e-404b-9b90-e5c9a0803b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:42.671372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616087b-243e-404b-9b90-e5c9a0803b29 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:42.671658 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616087b-243e-404b-9b90-e5c9a0803b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:42.671935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616087b-243e-404b-9b90-e5c9a0803b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:42.682280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616087b-243e-404b-9b90-e5c9a0803b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:42.684554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616087b-243e-404b-9b90-e5c9a0803b29 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:42.699948 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1113/2194] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:06:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:06:43.235575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:43.246859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:43.258044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbea7-e7d9-47a9-8450-94546b7031bc None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:43.264118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:43.264999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:43.265261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:43.265537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] PATH_INFO: `/v3/projects/5eea3b6745c74cddaf1a5482f89f0a30` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:43.266759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eea3b6745c74cddaf1a5482f89f0a30)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:43.269090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:43.373359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eea3b6745c74cddaf1a5482f89f0a30', 'request_id': 'req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:43.379488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eea3b6745c74cddaf1a5482f89f0a30', 'request_id': 'req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:43.499497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eea3b6745c74cddaf1a5482f89f0a30', 'request_id': 'req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:43.515020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] The token cache is being invalidate because project 5eea3b6745c74cddaf1a5482f89f0a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:06:43.515020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:43.515020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a98916d6-7656-4a2f-9c0b-b2d4680ffab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:06:43.515020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1082/2195] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:06:43 2021] DELETE /identity/v3/projects/5eea3b6745c74cddaf1a5482f89f0a30 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:43.521895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:43.522497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:43.522881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:43.551367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:43.552704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:43.658854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1114/2196] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:43.666924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:43.675284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:43.675284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:43.687633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:43.688939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:43.697419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1083/2197] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:06:43.703272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:43.716332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea846d9a-5cfc-4b69-851b-66a768fb3e8c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:43.719924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:43.720649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:43.720995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:43.721329 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:43.722125 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:06:43.722495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:43.724267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:43.736706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1115/2198] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:06:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:06:43.752337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:43.752337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcfd3-1648-4141-aea8-93b28f2f7acc None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:43.757690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:43.758362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:43.758681 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:43.759169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:43.759923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:43.763208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:43.909611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1084/2199] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:06:43 2021] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:06:43.913514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:43.924152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaae12-8378-4b73-ac7a-0577334eb98a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:43.983508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:43.984188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:43.984473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:43.984750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:43.985448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:43.987400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:44.106523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1116/2200] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:06:43 2021] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:06:44.110699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:44.122819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5dae-1c28-4268-9193-c0dcac8623e8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:44.130842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:44.131665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:44.132147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:44.132423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:44.133163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:44.134804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:44.152694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1085/2201] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:06:44 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:06:44.156736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:44.168442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394b49d-b13e-49ce-95d4-fdd831d84ae3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:44.176845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a985021-a4f0-421b-8589-8a4be960ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:44.178486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985021-a4f0-421b-8589-8a4be960ca8c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:44.178606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985021-a4f0-421b-8589-8a4be960ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:44.178982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985021-a4f0-421b-8589-8a4be960ca8c admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:44.179766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a985021-a4f0-421b-8589-8a4be960ca8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:44.181677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a985021-a4f0-421b-8589-8a4be960ca8c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:44.193244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1117/2202] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:06:44 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:06:44.210164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:44.210164 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1bc4-5348-4e10-b7cd-c47ba2e04af9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:44.214995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:44.215991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:44.216350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:44.216702 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] PATH_INFO: `/v3/projects/28d44e8045c24df28323402022ac9228/users/ee2fe0b619014522a8bd2bcaf7378660/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:44.238592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d44e8045c24df28323402022ac9228, user_id=ee2fe0b619014522a8bd2bcaf7378660, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:44.241302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:44.412361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1086/2203] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:06:44 2021] PUT /identity/v3/projects/28d44e8045c24df28323402022ac9228/users/ee2fe0b619014522a8bd2bcaf7378660/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:44.419203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:44.419491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:44.420607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:44.448085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:44.449359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:44.513084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1118/2204] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:44.523232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:44.525359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:44.584110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f08a-3f2c-4cac-8dbe-d72a3fb7e8a0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:44.588033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958203-86d2-4629-ad17-9b23d06e335e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:44.588695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958203-86d2-4629-ad17-9b23d06e335e service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:44.588964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958203-86d2-4629-ad17-9b23d06e335e service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:44.589840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958203-86d2-4629-ad17-9b23d06e335e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:44.599426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958203-86d2-4629-ad17-9b23d06e335e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:44.601093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958203-86d2-4629-ad17-9b23d06e335e service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:44.614365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1087/2205] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:06:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:06:45.097531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:45.099208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:45.206519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644915c-6012-4fac-8629-21016a7f3a15 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:45.211784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:45.212526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:45.212809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:45.213084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:45.215082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:45.226854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:45.228497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:45.239368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1119/2206] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:06:45 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:06:53.692258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:53.692714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:53.692797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:53.721654 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] MFA Rules not processed for user `ee2fe0b619014522a8bd2bcaf7378660`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:06:53.723238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:06:53.809254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1088/2207] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:06:53 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:06:53.813902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:53.827520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ad32-eee8-4f30-bda9-632f9773449a service placement] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:53.832143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:53.832801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:53.833267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:53.833538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:53.834385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:53.836343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:54.016831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1120/2208] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:06:53 2021] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:06:54.021514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:54.032781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836fbe0-815f-4bcd-9ded-2f8b1cfdf2a6 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:54.088882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:54.089715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:54.089996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:54.090271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:54.091006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:54.093039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:54.197589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1089/2209] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:06:54 2021] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:06:54.201879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:54.213181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536c0c-527d-474c-a478-7dc8a1cb558f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:54.218221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:54.218941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:54.219222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:54.219512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:54.220242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:54.221881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:54.240492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1121/2210] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:06:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:06:54.243807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:54.258165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ad9e2-4684-4a67-9c48-1d9a229a5e4c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:54.263217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:54.264106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:54.264386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:54.264661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] PATH_INFO: `/v3/projects/8db3c287e9874042b689ed03a4c7bd16/users/5a6c0184ff3345e38ca192d0f5abe0a4/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:54.280545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db3c287e9874042b689ed03a4c7bd16, user_id=5a6c0184ff3345e38ca192d0f5abe0a4, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:54.283241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:54.403058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1090/2211] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:06:54 2021] PUT /identity/v3/projects/8db3c287e9874042b689ed03a4c7bd16/users/5a6c0184ff3345e38ca192d0f5abe0a4/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:06:54.406960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:54.416799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8500b-2590-49b6-9d59-cea830ea42c8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:54.474871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8848df-4127-4740-af62-fffe6d7f3445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:54.475808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8848df-4127-4740-af62-fffe6d7f3445 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:54.476161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8848df-4127-4740-af62-fffe6d7f3445 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:54.476444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8848df-4127-4740-af62-fffe6d7f3445 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:54.477201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8848df-4127-4740-af62-fffe6d7f3445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:54.478899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8848df-4127-4740-af62-fffe6d7f3445 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:54.492439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1122/2212] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:06:54 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:06:54.495006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:06:54.506269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6e0a-1b63-4013-88d9-96196a0131f9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:06:54.511347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:06:54.512270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:06:54.512557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:06:54.512839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] PATH_INFO: `/v3/projects/8db3c287e9874042b689ed03a4c7bd16/users/5a6c0184ff3345e38ca192d0f5abe0a4/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:06:54.515121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db3c287e9874042b689ed03a4c7bd16, user_id=5a6c0184ff3345e38ca192d0f5abe0a4, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:06:54.517762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:06:54.530128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1091/2213] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:06:54 2021] PUT /identity/v3/projects/8db3c287e9874042b689ed03a4c7bd16/users/5a6c0184ff3345e38ca192d0f5abe0a4/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:01.648444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeee98-6239-4489-8745-7a890df6fcd8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:01.648969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeee98-6239-4489-8745-7a890df6fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:01.649081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbeee98-6239-4489-8745-7a890df6fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:01.682536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fdbeee98-6239-4489-8745-7a890df6fcd8 None None] MFA Rules not processed for user `5a6c0184ff3345e38ca192d0f5abe0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:01.684286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fdbeee98-6239-4489-8745-7a890df6fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:01.773606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1123/2214] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:01 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:01.787611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:01.789616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:01.904197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cedfc-e962-4ac1-beb8-4a471a97fc4d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:01.907960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:01.908617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:01.908896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:01.909248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:01.977071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:01.979722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:02.003697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1092/2215] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:01 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:02.286776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:02.287375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:02.287955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:02.357652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:02.359028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:02.443277 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1124/2216] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:07:02 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:02.500120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:02.501860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:02.613233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997990f-f41b-4b4f-9d87-55dd1341708c service glance] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:02.621280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffe51f-6ca6-48d6-9a65-150d40c6df5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:02.627006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffe51f-6ca6-48d6-9a65-150d40c6df5d service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:02.627006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffe51f-6ca6-48d6-9a65-150d40c6df5d service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:02.627006 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffe51f-6ca6-48d6-9a65-150d40c6df5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:02.632809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffe51f-6ca6-48d6-9a65-150d40c6df5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:02.634534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffe51f-6ca6-48d6-9a65-150d40c6df5d service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:02.643625 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1093/2217] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:07:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:07:13.544884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:13.546412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:13.607235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ad04f-993a-443e-9f61-ad266bfe39ee None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:13.610876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:13.611529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:13.611838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:13.612115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:13.613906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:13.689086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:13.690641 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:13.701358 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1125/2218] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:13 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:15.577860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:15.578378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:15.578583 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:15.597360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] MFA Rules not processed for user `ee2fe0b619014522a8bd2bcaf7378660`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:15.598686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:15.607484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1094/2219] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:15 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:16.903207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:16.905343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:17.027205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213282a5-63f0-4610-868a-126d203b34fd service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:17.032718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:17.034465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:17.034652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:17.035087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] PATH_INFO: `/v3/users/09ee35f66a4c4cb987f20990e974961f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:17.036671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ee35f66a4c4cb987f20990e974961f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:17.041997 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:17.374963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ee35f66a4c4cb987f20990e974961f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:17.376320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ee35f66a4c4cb987f20990e974961f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:17.455266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ee35f66a4c4cb987f20990e974961f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:17.456374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ee35f66a4c4cb987f20990e974961f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:17.478662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-42ebe544-90ce-46ce-b5bb-ed07cc113f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ee35f66a4c4cb987f20990e974961f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:17.493908 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1126/2220] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:16 2021] DELETE /identity/v3/users/09ee35f66a4c4cb987f20990e974961f => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:17.813995 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:17.823771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff961-1ea5-4687-877a-a52824dca6c0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:17.896917 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:17.898434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:17.898977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:17.899484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] PATH_INFO: `/v3/projects/5030fe8a997e416683658c321efaef5e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:17.902205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5030fe8a997e416683658c321efaef5e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:17.906468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.039149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5030fe8a997e416683658c321efaef5e', 'request_id': 'req-290fc145-ec8f-4e1c-a8c9-d62231e9da96'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:18.047390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5030fe8a997e416683658c321efaef5e', 'request_id': 'req-290fc145-ec8f-4e1c-a8c9-d62231e9da96'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:18.133706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5030fe8a997e416683658c321efaef5e', 'request_id': 'req-290fc145-ec8f-4e1c-a8c9-d62231e9da96'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:18.145646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] The token cache is being invalidate because project 5030fe8a997e416683658c321efaef5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:18.146010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:18.146763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-290fc145-ec8f-4e1c-a8c9-d62231e9da96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:18.148372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1095/2221] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:17 2021] DELETE /identity/v3/projects/5030fe8a997e416683658c321efaef5e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:18.155538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.156030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.156144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.178531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:18.179937 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:18.240772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1127/2222] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:18.249167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.249457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.252531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.268235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:18.269546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:18.278665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1096/2223] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:18.282974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:18.293295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6bfd4-60f1-45f7-a9b2-c052db3b3ab0 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:18.298282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:18.299184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.299546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.299823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.300893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:18.301213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:18.302882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.318902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1128/2224] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:07:18.331463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:18.341907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb6a45-b4c2-48ea-a237-be8ee09c979e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:18.347581 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:18.348552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.348992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.349431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.350285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:18.352230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.503896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1097/2225] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:18 2021] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:18.506970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:18.517961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5e2d4-1148-4b2b-b06a-a498d73fac4c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:18.573855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:18.574541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.574859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.575134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.575850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:18.577820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.678401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1129/2226] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:18 2021] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:18.686254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:18.705961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412701e-fb80-49a5-9d05-4529d723eae3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:18.712087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:18.712764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.713048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.713327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.714710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:18.716599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.727690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1098/2227] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:18 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:18.732421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:18.742734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b38cce-d1a6-4fd4-8866-c7c17438fee6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:18.747965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c0ba-73ab-4251-847d-40d739c3e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:18.749854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c0ba-73ab-4251-847d-40d739c3e7ed admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.749854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c0ba-73ab-4251-847d-40d739c3e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.749854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c0ba-73ab-4251-847d-40d739c3e7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.749854 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012c0ba-73ab-4251-847d-40d739c3e7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:18.751456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012c0ba-73ab-4251-847d-40d739c3e7ed admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.762340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1130/2228] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:18.766635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:18.778171 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772e55a-5b91-42a2-9913-ad9164a41519 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:18.785513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:18.786548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.786972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.787258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] PATH_INFO: `/v3/projects/4a61c4688904491994ffbb60c93fbacf/users/0126ea229ed44e499f747e140835761d/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:18.809644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a61c4688904491994ffbb60c93fbacf, user_id=0126ea229ed44e499f747e140835761d, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:18.812952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:18.966036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1099/2229] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:18 2021] PUT /identity/v3/projects/4a61c4688904491994ffbb60c93fbacf/users/0126ea229ed44e499f747e140835761d/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:18.973895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2d6c-f859-4646-912f-0e1e35d42904 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:18.974289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2d6c-f859-4646-912f-0e1e35d42904 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:18.974668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2d6c-f859-4646-912f-0e1e35d42904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:19.003382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-dcad2d6c-f859-4646-912f-0e1e35d42904 None None] MFA Rules not processed for user `0126ea229ed44e499f747e140835761d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:19.004604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-dcad2d6c-f859-4646-912f-0e1e35d42904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:19.070345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1131/2230] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:19.082357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:19.084114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:19.192037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656104-5735-4d4a-8716-5adce1d61a1a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:19.200410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:19.201220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:19.201543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:19.202015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:19.212749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:19.214967 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:19.223810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1100/2231] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:20.661733 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:20.671731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:20.671731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:20.683262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:20.684494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:20.743923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1132/2232] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:07:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:20.757739 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:20.759442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:20.846165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fd505-6511-4fe6-980e-94a6c454bfa0 service nova] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:20.853618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca448a-8b11-4a82-b4d8-512d2e2a4b98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:20.854423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca448a-8b11-4a82-b4d8-512d2e2a4b98 service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:20.855125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca448a-8b11-4a82-b4d8-512d2e2a4b98 service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:20.855660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca448a-8b11-4a82-b4d8-512d2e2a4b98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:20.865342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca448a-8b11-4a82-b4d8-512d2e2a4b98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:20.868678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca448a-8b11-4a82-b4d8-512d2e2a4b98 service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:20.879193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1101/2233] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:07:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:22.492120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:22.493685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:22.568511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f451ce4-9eff-4c05-8fea-25807e11ac25 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:22.574636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:22.575814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:22.576258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:22.576602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] PATH_INFO: `/v3/users/2d19d9ec20ee4b1aa347359539a697f2` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:22.578204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d19d9ec20ee4b1aa347359539a697f2)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:22.581021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:22.814368 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d19d9ec20ee4b1aa347359539a697f2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:22.815365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d19d9ec20ee4b1aa347359539a697f2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:22.914505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d19d9ec20ee4b1aa347359539a697f2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:22.915474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d19d9ec20ee4b1aa347359539a697f2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:22.930790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d19d9ec20ee4b1aa347359539a697f2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:22.960086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1133/2234] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:22 2021] DELETE /identity/v3/users/2d19d9ec20ee4b1aa347359539a697f2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:22.965886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:22.966430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:22.966430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:23.001649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:23.003129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:23.066516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1102/2235] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:23.077076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:23.078474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:23.138407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981fe05-5dbd-4b97-99f1-9d213afffd48 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:23.142287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:23.142972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:23.143288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:23.143559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:23.153246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:23.154701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:23.165326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1134/2236] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:07:23.696017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:23.697584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:23.710733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c4db-7ca7-49ff-a362-aafc3d816ba7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:23.717094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:23.724399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:23.724399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:23.724399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] PATH_INFO: `/v3/projects/bfb3a8a05e4c47748a9b68ab19f809b3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:23.724399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb3a8a05e4c47748a9b68ab19f809b3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:23.724399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:23.924582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb3a8a05e4c47748a9b68ab19f809b3', 'request_id': 'req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:23.933627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb3a8a05e4c47748a9b68ab19f809b3', 'request_id': 'req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:23.949323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:23.951322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:23.967556 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726325f5-88e3-48ea-8821-521ad1c970a4 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.001888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb3a8a05e4c47748a9b68ab19f809b3', 'request_id': 'req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.035202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] The token cache is being invalidate because project bfb3a8a05e4c47748a9b68ab19f809b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:24.035613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.036316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-bd0fd3ee-5f3f-4597-9fe7-c5ca6b511d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.042790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1103/2237] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:23 2021] DELETE /identity/v3/projects/bfb3a8a05e4c47748a9b68ab19f809b3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:24.044789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e914c2-186e-4b61-9edb-48a76c7bd54c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.045083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e914c2-186e-4b61-9edb-48a76c7bd54c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.045371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e914c2-186e-4b61-9edb-48a76c7bd54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.058863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.060116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.060560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.060987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] PATH_INFO: `/v3/users/0126ea229ed44e499f747e140835761d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.062771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0126ea229ed44e499f747e140835761d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.066026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.092453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a3e914c2-186e-4b61-9edb-48a76c7bd54c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:24.095459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a3e914c2-186e-4b61-9edb-48a76c7bd54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:24.128837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1104/2238] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:24.131378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.131734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.132079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.157156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:24.160906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:24.170206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1105/2239] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:24.174460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.184251 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1aaa1-4fdc-4725-885c-7b510d231bb8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.192987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.194214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.194503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.194828 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.195569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:24.195874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.197469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.215185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1106/2240] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:07:24.216117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.228114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c116-f454-410f-83fd-a6ec9f4a03af admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.245696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.246413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.246704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.247004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.247729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.249756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.336495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0126ea229ed44e499f747e140835761d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.337628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0126ea229ed44e499f747e140835761d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.359088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1107/2241] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:24 2021] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:24.363105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.425651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0126ea229ed44e499f747e140835761d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.426390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0126ea229ed44e499f747e140835761d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.428081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826173-0f81-4399-9e22-f7bce11b92df admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.433853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.437693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.437693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.437693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.437693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.438063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.440355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8751c492-12fa-4b27-8340-94833ff23522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0126ea229ed44e499f747e140835761d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:24.460695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1135/2242] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:23 2021] DELETE /identity/v3/users/0126ea229ed44e499f747e140835761d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:24.462633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.462995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.463376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.481851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:24.483279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:24.544263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1108/2243] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:24 2021] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:24.545578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.547801 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:24.561639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1136/2244] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:24.562174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f192-1f3e-485d-9277-60bb012aebaa admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.567655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.568575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.569060 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.569540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.570450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.572201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.576167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.578173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:24.590089 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1109/2245] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:24 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:24.599524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.611863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80bae-c7aa-4a58-ade2-94c6ac84a3b0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.618224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.618515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.619981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.619981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.621630 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.622295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.634590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1110/2246] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:24 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:24.641086 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:24.650598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d59e7-e05a-4793-ba5f-c00cc6b909d3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.651985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020565-a681-4bd3-bcf2-b729308d6fa8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:24.654859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae273a0-de4b-4297-90e7-fa39a302d256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.655569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae273a0-de4b-4297-90e7-fa39a302d256 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.655976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae273a0-de4b-4297-90e7-fa39a302d256 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.656209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae273a0-de4b-4297-90e7-fa39a302d256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.656888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:24.657784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.658065 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.658391 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] PATH_INFO: `/v3/projects/769d70d40946487c899a78bcec6dca8f/users/7037ec4eba3d404487514e3bee56a21e/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.666367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae273a0-de4b-4297-90e7-fa39a302d256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.668055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae273a0-de4b-4297-90e7-fa39a302d256 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.678399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769d70d40946487c899a78bcec6dca8f, user_id=7037ec4eba3d404487514e3bee56a21e, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:24.681778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:24.690708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1137/2247] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:07:24.809088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1111/2248] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:24 2021] PUT /identity/v3/projects/769d70d40946487c899a78bcec6dca8f/users/7037ec4eba3d404487514e3bee56a21e/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:24.827099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:24.827608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:24.828096 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:24.871986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] MFA Rules not processed for user `7037ec4eba3d404487514e3bee56a21e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:24.873261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:25.013691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1138/2249] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:24 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:25.014242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:25.014242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:25.042486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aecb37-5ce7-4ee4-9199-e3f8e93abee2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:25.046496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cd45c-55ea-41a7-abb6-d53fd3bce83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:25.046948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cd45c-55ea-41a7-abb6-d53fd3bce83a service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:25.047111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cd45c-55ea-41a7-abb6-d53fd3bce83a service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:25.047538 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cd45c-55ea-41a7-abb6-d53fd3bce83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:25.058994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cd45c-55ea-41a7-abb6-d53fd3bce83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:25.060547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cd45c-55ea-41a7-abb6-d53fd3bce83a service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:25.078057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1112/2250] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:24 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:25.444732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:25.446596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:25.556055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aff88-e913-4df2-8c42-40d3ad5b56fe None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:25.562042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:25.562921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:25.563302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:25.563672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] PATH_INFO: `/v3/projects/4a61c4688904491994ffbb60c93fbacf` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:25.565343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a61c4688904491994ffbb60c93fbacf)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:25.567443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:25.686731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a61c4688904491994ffbb60c93fbacf', 'request_id': 'req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:25.795421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a61c4688904491994ffbb60c93fbacf', 'request_id': 'req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:25.804882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a61c4688904491994ffbb60c93fbacf', 'request_id': 'req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:25.817362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] The token cache is being invalidate because project 4a61c4688904491994ffbb60c93fbacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:25.817661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:25.818449 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6c7199c3-03bf-4b1d-9d7c-a9da25695aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:25.820027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1139/2251] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:25 2021] DELETE /identity/v3/projects/4a61c4688904491994ffbb60c93fbacf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:25.826765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:25.827442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:25.827981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:25.856208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:25.857575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:25.927492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1113/2252] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:25.938448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:25.938983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:25.939515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:25.959276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:25.960519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:25.974595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1140/2253] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:25.974814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:25.985553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211565cd-c943-4a6f-8a29-79dd0ccb353e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:25.990451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:25.991214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:25.991494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:25.991769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:25.992499 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:25.992996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:25.995767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.008194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1114/2254] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:07:26.014582 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.023091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521847-8455-400c-b5ff-d48b3c7d76be None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.029523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.030229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.030838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.030838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.031592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.033502 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.131306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1141/2255] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:26 2021] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:26.135750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.146243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12880-3d49-407f-a0a6-6a90accb9fe5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.204249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.204927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.205211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.205486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.206207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.211900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.299993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1115/2256] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:26 2021] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:26.304307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.333995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafb7b1-b6cd-459f-908c-356fd502b001 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.344675 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.350420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.350420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.350420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.350420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.350420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.361528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1142/2257] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:26.365386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.375951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3936c4-e9c8-4453-907c-92abd101db3e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.380827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda13187-8f68-4cb6-9d72-eb0f75b5baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.381657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda13187-8f68-4cb6-9d72-eb0f75b5baee admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.382076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda13187-8f68-4cb6-9d72-eb0f75b5baee admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.382468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda13187-8f68-4cb6-9d72-eb0f75b5baee admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.383387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda13187-8f68-4cb6-9d72-eb0f75b5baee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.385120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda13187-8f68-4cb6-9d72-eb0f75b5baee admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.396710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1116/2258] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:26.401406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.412708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93532715-9c7e-4bcd-b332-597367b52ed8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.424885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.426953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.426953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.426953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] PATH_INFO: `/v3/projects/a8c5966c03f94fb49fa20b43babb89a8/users/d7effc2a41e349608ce39025612ed63b/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.445148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c5966c03f94fb49fa20b43babb89a8, user_id=d7effc2a41e349608ce39025612ed63b, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.448773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.546280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1143/2259] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:26 2021] PUT /identity/v3/projects/a8c5966c03f94fb49fa20b43babb89a8/users/d7effc2a41e349608ce39025612ed63b/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:26.562509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.563161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.563602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.609293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] MFA Rules not processed for user `d7effc2a41e349608ce39025612ed63b`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:26.611250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:26.681413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1117/2260] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:26 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:26.686537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.758070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45b52e-b6c2-437e-99e7-fb7266b5ee1b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.763571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.764244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.764530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.764814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.765525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.768137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:26.881870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1144/2261] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:26 2021] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:26.886209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:26.896922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd874d-4328-4453-b63d-3ac6c0295911 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:26.959325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:26.960551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:26.960932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:26.961220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:26.961967 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:26.965309 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.086926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1118/2262] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:26 2021] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:27.091274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.101600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c2b59-651d-4204-bb48-9ad727059ed6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.107441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.108121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.108405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.108683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.109411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.111053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.122133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1145/2263] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:27.126115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.136596 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b42040-47e2-452a-9716-fd71c81b0ceb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.141239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c4229-06b0-4151-9ead-c38e45e3c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.141907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c4229-06b0-4151-9ead-c38e45e3c524 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.142185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c4229-06b0-4151-9ead-c38e45e3c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.142460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c4229-06b0-4151-9ead-c38e45e3c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.143226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c4229-06b0-4151-9ead-c38e45e3c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.144817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c4229-06b0-4151-9ead-c38e45e3c524 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.156087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1119/2264] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:27.160667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.172409 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208da9db-d779-457f-b2c6-b7bad58c00ff admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.177547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.178365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.178690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.178964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] PATH_INFO: `/v3/projects/c505eb0ea2ac4a769bbf2244efacc0d0/users/23ebc723e75c48a787feb1283ca340e6/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.194339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c505eb0ea2ac4a769bbf2244efacc0d0, user_id=23ebc723e75c48a787feb1283ca340e6, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.197050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.301662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1146/2265] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:27 2021] PUT /identity/v3/projects/c505eb0ea2ac4a769bbf2244efacc0d0/users/23ebc723e75c48a787feb1283ca340e6/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:27.311834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.312126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.312410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.340360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] MFA Rules not processed for user `23ebc723e75c48a787feb1283ca340e6`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:27.341590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:27.412202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1120/2266] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:27 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:27.417349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.481250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683a948-0d7d-45d3-872b-5f134a03c8d0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.486169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.486856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.487137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.487414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.488138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.490050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.647217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1147/2267] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:27 2021] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:27.648615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.659706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a7f3f-942c-41b9-822e-2eb26c1d8806 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.716527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.717199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.717481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.717755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.718440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.720387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.855062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1121/2268] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:27 2021] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:27.856284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.870014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716c388-139e-4549-b5c9-b31a73e8c224 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.872973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.873652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.873937 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.874212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.874972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.876786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:27.888279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1148/2269] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:27.892797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:27.906766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5718-4b64-4e7f-8335-a3d38e4d2ca8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:27.913263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de131-8279-48d6-8c65-eeab80cc236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:27.914485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de131-8279-48d6-8c65-eeab80cc236f admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:27.914799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de131-8279-48d6-8c65-eeab80cc236f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:27.915080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de131-8279-48d6-8c65-eeab80cc236f admin admin] PATH_INFO: `/v3/projects/027acc138adf49ce90a4ba2df472ac3e/users/024d33611e504863a61e2c09869eba3b/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:27.944046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de131-8279-48d6-8c65-eeab80cc236f admin admin] RBAC: Authorizing `identity:create_grant(project_id=027acc138adf49ce90a4ba2df472ac3e, user_id=024d33611e504863a61e2c09869eba3b, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:27.944046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de131-8279-48d6-8c65-eeab80cc236f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:28.080010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1122/2270] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:27 2021] PUT /identity/v3/projects/027acc138adf49ce90a4ba2df472ac3e/users/024d33611e504863a61e2c09869eba3b/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:28.084094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:28.101565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e70e52-56bb-4754-901d-2301f8b54d4a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:28.116929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f2054-e98d-4f72-bdb6-8a8b004373af None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:28.117218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f2054-e98d-4f72-bdb6-8a8b004373af None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:28.117501 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f2054-e98d-4f72-bdb6-8a8b004373af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:28.136030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d95f2054-e98d-4f72-bdb6-8a8b004373af None None] MFA Rules not processed for user `7037ec4eba3d404487514e3bee56a21e`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:28.137302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d95f2054-e98d-4f72-bdb6-8a8b004373af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:28.160653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:28.161324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:28.161606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:28.161880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:28.162632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:28.164243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:28.178482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1149/2271] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:28 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:28.180366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:28.197990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc948b32-3918-49fa-98a6-ed8fd67951da admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:28.206053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:28.207683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:28.208289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:28.208907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] PATH_INFO: `/v3/projects/027acc138adf49ce90a4ba2df472ac3e/users/024d33611e504863a61e2c09869eba3b/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:28.212413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027acc138adf49ce90a4ba2df472ac3e, user_id=024d33611e504863a61e2c09869eba3b, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:28.214533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1123/2272] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:28 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:28.217968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:28.236496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1150/2273] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:28 2021] PUT /identity/v3/projects/027acc138adf49ce90a4ba2df472ac3e/users/024d33611e504863a61e2c09869eba3b/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:28.248072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:28.248476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:28.249167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:28.282156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] MFA Rules not processed for user `024d33611e504863a61e2c09869eba3b`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:28.283646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:28.359179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1124/2274] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:28 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:28.370237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:28.373166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:28.457689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1a4-5dbf-4821-9b7a-9d2e1b55f035 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:28.461777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:28.462436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:28.464079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:28.464750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:28.475495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:28.477136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:28.488215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1151/2275] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:28 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:30.902147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:30.903679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:30.916982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ba3e-ddff-45e8-890a-de976134cf9f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:30.937265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:30.938231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:30.938406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:30.938677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:31.016588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:31.019033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:31.034036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1125/2276] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:38.688133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:38.699605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eb7a3-8fb9-4b01-9a63-6050d649b726 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:38.703430 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b006e2f-fb2f-429f-84da-104164beb483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:38.705321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b006e2f-fb2f-429f-84da-104164beb483 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:38.705321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b006e2f-fb2f-429f-84da-104164beb483 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:38.705321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b006e2f-fb2f-429f-84da-104164beb483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:38.761905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b006e2f-fb2f-429f-84da-104164beb483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:38.763391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b006e2f-fb2f-429f-84da-104164beb483 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:38.772439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1152/2277] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:38 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:44.567644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:44.633423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880bf6c-2272-498d-8dee-0fc402c51586 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:44.638193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:44.639105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:44.639385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:44.639660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] PATH_INFO: `/v3/users/d7effc2a41e349608ce39025612ed63b` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:44.640868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7effc2a41e349608ce39025612ed63b)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:44.642815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:44.920867 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7effc2a41e349608ce39025612ed63b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:45.057211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7effc2a41e349608ce39025612ed63b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:45.069955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7effc2a41e349608ce39025612ed63b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:45.070712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7effc2a41e349608ce39025612ed63b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:45.071336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7effc2a41e349608ce39025612ed63b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:45.083987 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1126/2278] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:44 2021] DELETE /identity/v3/users/d7effc2a41e349608ce39025612ed63b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:45.089258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:45.089822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:45.089822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:45.108093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:45.110227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:45.173772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1153/2279] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:45.185097 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:45.189614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:45.244773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbe19e-41db-41a5-b20b-e46bb982af37 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:45.248436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:45.249094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:45.249376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:45.249651 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:45.258951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:45.260909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:45.272943 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1127/2280] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:45.843980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:45.851061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:45.862138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21550-803f-4a0d-bd0f-3432a84168b6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:45.868446 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:45.869856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:45.869856 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:45.870225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] PATH_INFO: `/v3/projects/a8c5966c03f94fb49fa20b43babb89a8` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:45.872894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c5966c03f94fb49fa20b43babb89a8)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:45.876162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:46.084918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c5966c03f94fb49fa20b43babb89a8', 'request_id': 'req-db82926d-e335-4786-9899-ddb5c1fa1161'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.198621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c5966c03f94fb49fa20b43babb89a8', 'request_id': 'req-db82926d-e335-4786-9899-ddb5c1fa1161'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.206739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c5966c03f94fb49fa20b43babb89a8', 'request_id': 'req-db82926d-e335-4786-9899-ddb5c1fa1161'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.220757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] The token cache is being invalidate because project a8c5966c03f94fb49fa20b43babb89a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:46.221048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.221743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.223382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1154/2281] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:45 2021] DELETE /identity/v3/projects/a8c5966c03f94fb49fa20b43babb89a8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:46.227540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:46.238794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f386-b883-4094-9c25-e11899a95176 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:46.305270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:46.306891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:46.321194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:46.321194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] PATH_INFO: `/v3/users/23ebc723e75c48a787feb1283ca340e6` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:46.321194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ebc723e75c48a787feb1283ca340e6)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:46.321194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:46.512286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ebc723e75c48a787feb1283ca340e6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.631848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ebc723e75c48a787feb1283ca340e6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.647456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ebc723e75c48a787feb1283ca340e6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.648230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ebc723e75c48a787feb1283ca340e6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.648878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ebc723e75c48a787feb1283ca340e6'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:46.663700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1128/2282] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:46 2021] DELETE /identity/v3/users/23ebc723e75c48a787feb1283ca340e6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:47.376874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:47.378509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:47.396543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82926d-e335-4786-9899-ddb5c1fa1161 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:47.464550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:47.465421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:47.465710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:47.465986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] PATH_INFO: `/v3/projects/c505eb0ea2ac4a769bbf2244efacc0d0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:47.467306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c505eb0ea2ac4a769bbf2244efacc0d0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:47.469243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:47.675895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c505eb0ea2ac4a769bbf2244efacc0d0', 'request_id': 'req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:47.840588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c505eb0ea2ac4a769bbf2244efacc0d0', 'request_id': 'req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:47.847194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c505eb0ea2ac4a769bbf2244efacc0d0', 'request_id': 'req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:47.859830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] The token cache is being invalidate because project c505eb0ea2ac4a769bbf2244efacc0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:47.860132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:47.860906 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:47.862479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1155/2283] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:47 2021] DELETE /identity/v3/projects/c505eb0ea2ac4a769bbf2244efacc0d0 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:47.866698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:47.868177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:47.882179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4567-aede-4bd4-965e-96a65f9dda74 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:47.941842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:47.942804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:47.943096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:47.943500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] PATH_INFO: `/v3/users/024d33611e504863a61e2c09869eba3b` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:47.944780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] RBAC: Authorizing `identity:delete_user(user_id=024d33611e504863a61e2c09869eba3b)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:47.946750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:48.277834 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024d33611e504863a61e2c09869eba3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:48.407339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024d33611e504863a61e2c09869eba3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:48.420882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024d33611e504863a61e2c09869eba3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:48.421684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024d33611e504863a61e2c09869eba3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:48.422358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1be4d4ad-92d7-48fe-bcd7-fb660ae3585b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024d33611e504863a61e2c09869eba3b'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:48.435927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1129/2284] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:47 2021] DELETE /identity/v3/users/024d33611e504863a61e2c09869eba3b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:49.282487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:49.283986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:49.317699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c4ba-c65c-4768-8f61-74e48f9ed8f3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:49.389922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:49.390830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:49.391112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:49.391397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] PATH_INFO: `/v3/projects/027acc138adf49ce90a4ba2df472ac3e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:49.392824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027acc138adf49ce90a4ba2df472ac3e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:49.394853 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:49.614627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027acc138adf49ce90a4ba2df472ac3e', 'request_id': 'req-e496c794-9562-4886-bd68-d8f96175e943'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:49.739192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027acc138adf49ce90a4ba2df472ac3e', 'request_id': 'req-e496c794-9562-4886-bd68-d8f96175e943'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:49.745905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027acc138adf49ce90a4ba2df472ac3e', 'request_id': 'req-e496c794-9562-4886-bd68-d8f96175e943'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:49.757431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] The token cache is being invalidate because project 027acc138adf49ce90a4ba2df472ac3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:49.757726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:49.758376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-e496c794-9562-4886-bd68-d8f96175e943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:49.760019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1156/2285] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:49 2021] DELETE /identity/v3/projects/027acc138adf49ce90a4ba2df472ac3e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:49.767261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:49.767755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:49.767954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:49.790963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:49.790963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:49.854872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1130/2286] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:49.864243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:49.864533 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:49.864895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:49.884916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:49.886744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:49.894925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1157/2287] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:49.905133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:49.915113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d736001-1992-4c95-8316-eb5d170ef8e3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:49.920212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:49.920977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:49.921262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:49.921542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:49.922272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:49.922617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:49.924468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:49.937910 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1131/2288] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:07:49.966499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:49.981908 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4414e86-974c-42b6-b931-8951fa768713 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:49.988551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:49.989454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:49.989808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:49.990160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:49.990999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:49.995998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:50.133467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1158/2289] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:49 2021] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:50.147796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:50.157626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b4309-8906-4bbd-9c68-19541d236649 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:50.213447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:50.214268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:50.214393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:50.214695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:50.219121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:50.219121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:50.379584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1132/2290] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:50 2021] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:50.383692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:50.395210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284723e-691d-467b-a5eb-6bf6aa04eb28 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:50.400011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:50.400683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:50.400973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:50.401242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:50.402042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:50.403772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:50.414678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1159/2291] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:50.422233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:50.434147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d310-bff6-4d9c-a3bf-9b999efb5e91 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:50.439322 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7e25e-b32b-405a-a559-06a1a6c6dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:50.440100 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7e25e-b32b-405a-a559-06a1a6c6dd97 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:50.440446 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7e25e-b32b-405a-a559-06a1a6c6dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:50.440822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7e25e-b32b-405a-a559-06a1a6c6dd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:50.441623 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7e25e-b32b-405a-a559-06a1a6c6dd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:50.443256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7e25e-b32b-405a-a559-06a1a6c6dd97 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:50.453708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1133/2292] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:50.457697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:50.475610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211ca06-926e-4b38-8a50-77a6bc2b9517 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:50.475610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:50.475610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:50.475610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:50.476792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] PATH_INFO: `/v3/projects/88f0cd4c5a78420abdec984c4488c04a/users/2331a1a93a07444ca1a1328773ca7cf9/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:50.490927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f0cd4c5a78420abdec984c4488c04a, user_id=2331a1a93a07444ca1a1328773ca7cf9, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:50.493882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:50.629050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1160/2293] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:50 2021] PUT /identity/v3/projects/88f0cd4c5a78420abdec984c4488c04a/users/2331a1a93a07444ca1a1328773ca7cf9/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:50.654252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:50.654542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:50.654879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:50.683382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] MFA Rules not processed for user `2331a1a93a07444ca1a1328773ca7cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:50.684354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:50.750364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1134/2294] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:50 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:50.754994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:50.822205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ccf6-161e-4563-864d-baffebd3b79c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:50.827184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:50.827858 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:50.828142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:50.828422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:50.829110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:50.831058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:50.941356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1161/2295] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:50 2021] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:50.945700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:50.957087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3530e7d-be81-4edb-8efe-930623c34142 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:51.023852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:51.023852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.023852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.023852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.024378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:51.024378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:51.145933 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1135/2296] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:50 2021] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:51.150550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:51.164258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93734-26f1-40f0-98be-5b94c1cd96b4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:51.169097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:51.169765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.170047 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.170484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.171251 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:51.172848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:51.185785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1162/2297] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:51 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:51.205503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:51.215969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98521f-32d9-4f29-a0d7-ac23e7d59b02 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:51.221218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:51.222125 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.222407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.223196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] PATH_INFO: `/v3/projects/60568bc277174d33ab93babb4fec7f55/users/6fee7d75dc0746469a5f4008091fb996/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.245782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=60568bc277174d33ab93babb4fec7f55, user_id=6fee7d75dc0746469a5f4008091fb996, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:51.248600 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:51.373924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1136/2298] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:51 2021] PUT /identity/v3/projects/60568bc277174d33ab93babb4fec7f55/users/6fee7d75dc0746469a5f4008091fb996/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:51.378132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:51.389941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da9d1c-0ea9-4215-a76b-00fada34e3a2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:51.468206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d710a-0a9a-458d-b096-86c8c84568c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:51.469477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d710a-0a9a-458d-b096-86c8c84568c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.469477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d710a-0a9a-458d-b096-86c8c84568c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.469734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d710a-0a9a-458d-b096-86c8c84568c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.470258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d710a-0a9a-458d-b096-86c8c84568c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:51.471919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d710a-0a9a-458d-b096-86c8c84568c1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:51.482977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1163/2299] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:51 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:51.487280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:51.498007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58c016-3cf7-4240-aaad-dee8f1bdf6df admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:51.503260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:51.504160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.504442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.504719 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] PATH_INFO: `/v3/projects/60568bc277174d33ab93babb4fec7f55/users/6fee7d75dc0746469a5f4008091fb996/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.506731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60568bc277174d33ab93babb4fec7f55, user_id=6fee7d75dc0746469a5f4008091fb996, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:51.509373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:51.522823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1137/2300] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:51 2021] PUT /identity/v3/projects/60568bc277174d33ab93babb4fec7f55/users/6fee7d75dc0746469a5f4008091fb996/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:51.535068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.535364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.535645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.566902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] MFA Rules not processed for user `6fee7d75dc0746469a5f4008091fb996`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:51.568656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:51.668059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1164/2301] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:51 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:51.680476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:51.684610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:51.783256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f5a87-4933-4624-b377-9c4717bfc962 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:51.786938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dece768-f186-4fe2-8679-d00b174f1edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:51.787763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece768-f186-4fe2-8679-d00b174f1edd service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:51.788044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece768-f186-4fe2-8679-d00b174f1edd service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:51.788443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece768-f186-4fe2-8679-d00b174f1edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:51.799250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece768-f186-4fe2-8679-d00b174f1edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:51.800684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece768-f186-4fe2-8679-d00b174f1edd service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:51.812080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1138/2302] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:51 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:52.468361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:52.535128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50021b2-5241-4ec8-b358-12b93c98c91f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:52.539914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:52.540723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:52.541002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:52.541375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] PATH_INFO: `/v3/users/2331a1a93a07444ca1a1328773ca7cf9` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:52.543424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2331a1a93a07444ca1a1328773ca7cf9)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:52.545398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:52.770011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2331a1a93a07444ca1a1328773ca7cf9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:52.770699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2331a1a93a07444ca1a1328773ca7cf9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:52.841882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2331a1a93a07444ca1a1328773ca7cf9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:52.842444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2331a1a93a07444ca1a1328773ca7cf9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:52.858678 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2331a1a93a07444ca1a1328773ca7cf9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:52.869240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1165/2303] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:52 2021] DELETE /identity/v3/users/2331a1a93a07444ca1a1328773ca7cf9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:07:52.874492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:52.874940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:52.875068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:52.907429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:52.908729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:52.975479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1139/2304] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:52.985498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:52.986967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:53.049629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8833e-e80c-465e-8826-956deafd1049 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:53.053273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:53.053935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:53.054217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:53.054491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:53.065155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:53.067123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:53.090646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1166/2305] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:53.598976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:53.600724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:53.626225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aabbe-8c16-4503-83bf-30141004f621 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:53.633242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:53.634470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:53.635200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:53.636332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] PATH_INFO: `/v3/projects/88f0cd4c5a78420abdec984c4488c04a` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:53.647850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f0cd4c5a78420abdec984c4488c04a)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:53.652307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:53.792478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f0cd4c5a78420abdec984c4488c04a', 'request_id': 'req-c525e003-0d36-4f05-ab0b-dacab0b54865'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:53.801182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f0cd4c5a78420abdec984c4488c04a', 'request_id': 'req-c525e003-0d36-4f05-ab0b-dacab0b54865'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:53.922173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f0cd4c5a78420abdec984c4488c04a', 'request_id': 'req-c525e003-0d36-4f05-ab0b-dacab0b54865'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:53.934817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] The token cache is being invalidate because project 88f0cd4c5a78420abdec984c4488c04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:53.935204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:53.935921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:53.937556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1140/2306] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:53 2021] DELETE /identity/v3/projects/88f0cd4c5a78420abdec984c4488c04a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:53.946962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:53.957644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56567ad-b59e-4793-a2f9-8147b20cd6d9 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:54.028600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:54.029542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:54.029844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:54.030143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] PATH_INFO: `/v3/users/6fee7d75dc0746469a5f4008091fb996` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:54.031548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fee7d75dc0746469a5f4008091fb996)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:54.033864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:54.345534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fee7d75dc0746469a5f4008091fb996'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:54.346269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fee7d75dc0746469a5f4008091fb996'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:54.431050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fee7d75dc0746469a5f4008091fb996'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:54.432060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fee7d75dc0746469a5f4008091fb996'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:54.446810 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cdc4dba5-477b-46d3-b3af-ad50df0fadae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fee7d75dc0746469a5f4008091fb996'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:54.469891 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1167/2307] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:53 2021] DELETE /identity/v3/users/6fee7d75dc0746469a5f4008091fb996 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:55.392289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:55.394743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:55.410936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525e003-0d36-4f05-ab0b-dacab0b54865 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:55.495214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:55.495214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:55.495214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:55.495214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] PATH_INFO: `/v3/projects/60568bc277174d33ab93babb4fec7f55` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:55.496380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60568bc277174d33ab93babb4fec7f55)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:55.498283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:55.716795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60568bc277174d33ab93babb4fec7f55', 'request_id': 'req-cb876aee-cf4f-4d15-aaac-647921d68245'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:55.723319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60568bc277174d33ab93babb4fec7f55', 'request_id': 'req-cb876aee-cf4f-4d15-aaac-647921d68245'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:55.840874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60568bc277174d33ab93babb4fec7f55', 'request_id': 'req-cb876aee-cf4f-4d15-aaac-647921d68245'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:55.852342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] The token cache is being invalidate because project 60568bc277174d33ab93babb4fec7f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:55.862036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:55.862036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cb876aee-cf4f-4d15-aaac-647921d68245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:55.862036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1141/2308] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:55 2021] DELETE /identity/v3/projects/60568bc277174d33ab93babb4fec7f55 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:55.862479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:55.862479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:55.863033 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:55.881193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:55.882401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:55.944696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1168/2309] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:55.954497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:55.954821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:55.955111 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:55.975127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:55.976370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:55.985558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1142/2310] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:55.996833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.007016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ec54-07cc-4ad2-944b-a7473eb94ece None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.012663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.013366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.013656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.013936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.014706 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:56.015018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.016696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:56.030095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1169/2311] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:07:56.034714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.044841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7c858-3f7e-4e85-8991-4d950e5c647f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.050127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.050831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.051119 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.051398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.052101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.054013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:56.226827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1143/2312] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:56 2021] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:56.231108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.241633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eecf4-2e5b-4aa5-aff3-31245a8a9490 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.306165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.308416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.308416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.308416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.309175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.311265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:56.435332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1170/2313] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:56 2021] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:56.438503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.449722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a571ac2-8a27-47e3-a168-19bf47e857e4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.459409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.460222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.460569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.461062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.461881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.463700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:56.477417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1144/2314] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:56.482374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.496941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df5b33-2dda-4e5d-9d0f-a60b9d4795f9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.502039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7965bf7-e07e-4de7-8fd2-8e8fb86729f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.502969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7965bf7-e07e-4de7-8fd2-8e8fb86729f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.503249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7965bf7-e07e-4de7-8fd2-8e8fb86729f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.503517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7965bf7-e07e-4de7-8fd2-8e8fb86729f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.504246 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7965bf7-e07e-4de7-8fd2-8e8fb86729f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.506024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7965bf7-e07e-4de7-8fd2-8e8fb86729f4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:56.520373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1171/2315] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:07:56.522182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.533908 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea527c-1d7e-4cf4-bfe2-47b0e28965e7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.545028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.545723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.546103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.546500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] PATH_INFO: `/v3/projects/374f1bef234d4f59b764ec19e26d0045/users/91b1d6589e214c70ad619c8335caa5f6/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.564081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f1bef234d4f59b764ec19e26d0045, user_id=91b1d6589e214c70ad619c8335caa5f6, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.567137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:56.687481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1145/2316] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:56 2021] PUT /identity/v3/projects/374f1bef234d4f59b764ec19e26d0045/users/91b1d6589e214c70ad619c8335caa5f6/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:56.701513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.701807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.702087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.730108 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] MFA Rules not processed for user `91b1d6589e214c70ad619c8335caa5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:56.731504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:56.818314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1172/2317] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:56 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:56.835202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:56.840749 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:56.961918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005293d1-233f-46b6-8cfa-7d892286f496 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:56.971483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:56.984046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:56.984046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:56.984046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:56.990725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:56.993272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:57.012993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1146/2318] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:56 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:57.037474 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:57.138942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303518-9947-4ded-a886-78c4668c72c1 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:57.145070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:57.145211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:57.145743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:57.146084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] PATH_INFO: `/v3/users/91b1d6589e214c70ad619c8335caa5f6` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:57.149363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b1d6589e214c70ad619c8335caa5f6)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:57.149965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:57.358766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:57.360427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:57.377074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cd74d-4b00-455c-a9ed-c8094a8426f5 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:57.384220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:57.385061 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:57.385980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:57.386266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] PATH_INFO: `/v3/users/a21ac4ce459d4eee9f73d4c7207968b4` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:57.387957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21ac4ce459d4eee9f73d4c7207968b4)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:57.392185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b1d6589e214c70ad619c8335caa5f6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.392573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:57.393366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b1d6589e214c70ad619c8335caa5f6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.499268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b1d6589e214c70ad619c8335caa5f6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.500237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b1d6589e214c70ad619c8335caa5f6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.519988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7725ce81-dba3-4e0a-9791-e9e31cc97a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b1d6589e214c70ad619c8335caa5f6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.540523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1173/2319] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:57 2021] DELETE /identity/v3/users/91b1d6589e214c70ad619c8335caa5f6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:57.545739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:57.546030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:57.546341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:57.566175 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:57.567431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:57.652734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21ac4ce459d4eee9f73d4c7207968b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.688947 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1174/2320] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:57.698517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:57.700411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:57.759861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21ac4ce459d4eee9f73d4c7207968b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.774653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21ac4ce459d4eee9f73d4c7207968b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.775347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21ac4ce459d4eee9f73d4c7207968b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.776551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401857f-bc01-4e53-8f30-eae655e7827a None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:57.776804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21ac4ce459d4eee9f73d4c7207968b4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:57.781626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:57.782621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:57.782783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:57.783466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:57.785466 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:57.790112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1147/2321] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:07:57 2021] DELETE /identity/v3/users/a21ac4ce459d4eee9f73d4c7207968b4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:57.801156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:57.802659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:57.815435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1175/2322] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:07:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:07:58.146861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:58.148413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:58.236485 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140616e-d983-4899-b772-f5eb4b2a9909 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:58.241599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:58.242477 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.242810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.243072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] PATH_INFO: `/v3/projects/c67ffd3553c245acabcdcfd5a15252e3` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.244620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67ffd3553c245acabcdcfd5a15252e3)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:58.246789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:58.505049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:58.507837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:58.516613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67ffd3553c245acabcdcfd5a15252e3', 'request_id': 'req-d93ea2d0-0093-46be-b7cb-c5390de59161'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.523394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67ffd3553c245acabcdcfd5a15252e3', 'request_id': 'req-d93ea2d0-0093-46be-b7cb-c5390de59161'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.526883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46e36-4b37-4130-9c94-9fc3f8a7bd2b service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:58.584491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:58.585360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.585640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.585928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] PATH_INFO: `/v3/projects/374f1bef234d4f59b764ec19e26d0045` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.587156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374f1bef234d4f59b764ec19e26d0045)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:58.589164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:58.616891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67ffd3553c245acabcdcfd5a15252e3', 'request_id': 'req-d93ea2d0-0093-46be-b7cb-c5390de59161'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.628153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] The token cache is being invalidate because project c67ffd3553c245acabcdcfd5a15252e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:58.628448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.629152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d93ea2d0-0093-46be-b7cb-c5390de59161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.630710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1148/2323] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:58 2021] DELETE /identity/v3/projects/c67ffd3553c245acabcdcfd5a15252e3 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:58.637840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6219f-8017-4059-a06c-9479fcad5f27 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.638524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6219f-8017-4059-a06c-9479fcad5f27 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.638909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6219f-8017-4059-a06c-9479fcad5f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.658435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5bc6219f-8017-4059-a06c-9479fcad5f27 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:58.659691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5bc6219f-8017-4059-a06c-9479fcad5f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:58.668722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1149/2324] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:58.676827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.677386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.677672 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.697399 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:58.699599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:58.708661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1150/2325] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:58.714768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:58.725637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3730b-9f81-4eaa-8f3c-3332999ab763 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:58.748198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:58.749017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.749374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.750531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.751040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:58.751286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:58.753277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:58.766401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374f1bef234d4f59b764ec19e26d0045', 'request_id': 'req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.773688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1151/2326] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:07:58.774684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:58.785231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57513c3-406f-4424-9034-c6b363ef527c admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:58.849764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:58.853312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.853312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.853312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.853312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:58.854827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:58.887097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374f1bef234d4f59b764ec19e26d0045', 'request_id': 'req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.887097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374f1bef234d4f59b764ec19e26d0045', 'request_id': 'req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.899927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] The token cache is being invalidate because project 374f1bef234d4f59b764ec19e26d0045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:07:58.900224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.901154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ca30c810-4593-4cf3-b4b5-d8fc81c81bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:07:58.902982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1176/2327] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:07:58 2021] DELETE /identity/v3/projects/374f1bef234d4f59b764ec19e26d0045 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:58.909206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1c6-fd39-4767-b2ed-505b7856b692 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.909563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1c6-fd39-4767-b2ed-505b7856b692 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.909780 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1c6-fd39-4767-b2ed-505b7856b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:58.941148 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-3524f1c6-fd39-4767-b2ed-505b7856b692 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:58.942396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3524f1c6-fd39-4767-b2ed-505b7856b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:58.954312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1152/2328] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:58 2021] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:58.958677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:58.962656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:58.967222 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1177/2329] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:58.976560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:58.976911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:58.977315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.004996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:59.006136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:59.037624 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a9965-0915-4ca5-ba1e-e6395bbed9ed admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.043537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.044578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.044578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.044788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.045476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.047508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.074726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1178/2330] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:59.079087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.089418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0c494-1c63-488e-84f3-12f22b8a6a33 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.094462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.095191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.095612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.095751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.096485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:07:59.096796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.098408 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.112254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1179/2331] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:07:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:07:59.116583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.126528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bdca-e917-46bf-8211-ec90d0e75985 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.131205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.131844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.132177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.132585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.133265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.135232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.191295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1153/2332] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:58 2021] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:07:59.202081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.212337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a7b8f-52f9-48fc-a952-52dc16304b96 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.219204 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.229545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.229545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.229545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.229545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.229545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.234390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1154/2333] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:59 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:59.238384 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.248362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb072c-1b78-4077-ad4e-9f8a2fee239e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.253156 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.253817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.254104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.254386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.255184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.256938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.267564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1155/2334] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:59.271566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.281864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492afd-558d-49ad-8a77-45cb075445f0 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.287011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e789266-d7f6-4a06-8e4e-dca8d3638c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.288351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e789266-d7f6-4a06-8e4e-dca8d3638c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.288351 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e789266-d7f6-4a06-8e4e-dca8d3638c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.292133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e789266-d7f6-4a06-8e4e-dca8d3638c56 admin admin] PATH_INFO: `/v3/projects/be4e016c227c4712b72df61014694ef1/users/cf7d4e758e6e4d2482fdfe4bc3d229c0/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.296723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1180/2335] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:59.301399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.305836 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e789266-d7f6-4a06-8e4e-dca8d3638c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4e016c227c4712b72df61014694ef1, user_id=cf7d4e758e6e4d2482fdfe4bc3d229c0, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.308615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e789266-d7f6-4a06-8e4e-dca8d3638c56 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.365431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fff74-a33d-43d4-a821-76b865d87902 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.370667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.371380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.371663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.371942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.372664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.374652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.425482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1156/2336] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:59 2021] PUT /identity/v3/projects/be4e016c227c4712b72df61014694ef1/users/cf7d4e758e6e4d2482fdfe4bc3d229c0/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:59.436547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.437091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.437367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.468676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1181/2337] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:59.468890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] MFA Rules not processed for user `cf7d4e758e6e4d2482fdfe4bc3d229c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:59.468890 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:59.471184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.482143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aec00-6277-4484-a764-a9e412a20ce2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.540927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1157/2338] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:07:59.541979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.546438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.547172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.547459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.547735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.548475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.550467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.561857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1182/2339] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:59 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:59.565385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.576056 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24e2f2-07dc-49c8-993e-350565172518 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.581367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.582101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.582385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.582694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.583513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.585204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.597672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1183/2340] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:07:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:07:59.603428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.614264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e133b-b363-4864-b677-6f4d7e9f3529 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.617080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a820c-f606-44d4-844e-e42259e8f3d4 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.619377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560765c4-9f43-4e02-b0b0-551c80ff2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.620319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560765c4-9f43-4e02-b0b0-551c80ff2e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.620620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560765c4-9f43-4e02-b0b0-551c80ff2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.620897 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560765c4-9f43-4e02-b0b0-551c80ff2e17 admin admin] PATH_INFO: `/v3/projects/613b5098ac494f47b44a8fefb6c538d4/users/8530323ecd9148f8b90558e644081573/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.621714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.622381 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.622697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.622980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.623708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.625676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.637734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560765c4-9f43-4e02-b0b0-551c80ff2e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613b5098ac494f47b44a8fefb6c538d4, user_id=8530323ecd9148f8b90558e644081573, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.641026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560765c4-9f43-4e02-b0b0-551c80ff2e17 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.781789 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1158/2341] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:07:59.785546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.848347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4374-821c-49e6-99ae-49839f9dd3c4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.849023 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1184/2342] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:07:59 2021] PUT /identity/v3/projects/613b5098ac494f47b44a8fefb6c538d4/users/8530323ecd9148f8b90558e644081573/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:07:59.859925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.864385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.864385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.890905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] MFA Rules not processed for user `8530323ecd9148f8b90558e644081573`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:07:59.892140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:07:59.936846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.939037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.939037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.939037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:07:59.939037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:07:59.942053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:07:59.971799 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1185/2343] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:07:59.976238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:07:59.987715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57657d8-35ec-4d34-8e46-aa51afed0d12 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:07:59.998015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:07:59.998744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:07:59.999027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:07:59.999336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.000134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.002122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.111154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1159/2344] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:08:00.111154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.118888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960978f-a896-42a1-8c49-153d834aa2e9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.124249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.124896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.125182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.125457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.126180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.127800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.139146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1160/2345] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:08:00.139350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1186/2346] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:07:59 2021] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:08:00.143362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.146993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.156937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1556b74-1d84-4b31-a24f-7d4381f85850 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.212553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b3692-5df7-49b2-95c2-5f13764616e1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.218185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255cb70-e84e-468a-807f-44fd3620df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.218372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.218902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255cb70-e84e-468a-807f-44fd3620df9a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.219222 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255cb70-e84e-468a-807f-44fd3620df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.219346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.219586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.219730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255cb70-e84e-468a-807f-44fd3620df9a admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.220185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] PATH_INFO: `/v3/projects/bf9583029d5a486198820501ef6b59e5/users/6f49b48946d2415d977ae6262f91ae0e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.220302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255cb70-e84e-468a-807f-44fd3620df9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.222215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255cb70-e84e-468a-807f-44fd3620df9a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.237819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9583029d5a486198820501ef6b59e5, user_id=6f49b48946d2415d977ae6262f91ae0e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.240640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.328162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1161/2347] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:08:00 2021] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:08:00.329796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.330093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.330377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.348135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:00.349350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:00.356712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1187/2348] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:08:00 2021] PUT /identity/v3/projects/bf9583029d5a486198820501ef6b59e5/users/6f49b48946d2415d977ae6262f91ae0e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:08:00.357544 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.406372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1162/2349] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:08:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:00.411138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.421448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908840-b4be-4f11-97f4-de1f05cd0f8e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.424457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084aab0-62d1-47f1-b6d2-f39d33d02240 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.426771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.427447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.427732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.428005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.428737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.429325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.429992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.430277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.430385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.430554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.431312 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.433811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.441494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1188/2350] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:00 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:08:00.442311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.446886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:00.447059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1163/2351] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:00 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:08:00.447059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.456112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00b0ae-2ea6-425a-b911-129daacc11aa admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.466232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.466232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.466232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.467319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.467682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.469421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.480876 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1164/2352] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:08:00.481701 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.493971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6231ff2-7979-4060-aad1-a03464d648c9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.501733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.501733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.501733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.501733 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] PATH_INFO: `/v3/projects/bf9583029d5a486198820501ef6b59e5/users/6f49b48946d2415d977ae6262f91ae0e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.504394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9583029d5a486198820501ef6b59e5, user_id=6f49b48946d2415d977ae6262f91ae0e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.507292 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.521273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1165/2353] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:08:00 2021] PUT /identity/v3/projects/bf9583029d5a486198820501ef6b59e5/users/6f49b48946d2415d977ae6262f91ae0e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:00.521983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.534106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e609d46-c205-4b0e-8fb3-a19822dcef79 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.601134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228916cd-3198-42a0-927c-56f536fbe82f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.607586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fcbff-d25f-427b-9e05-4252203e314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.608492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fcbff-d25f-427b-9e05-4252203e314b admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.608777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fcbff-d25f-427b-9e05-4252203e314b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.609067 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fcbff-d25f-427b-9e05-4252203e314b admin admin] PATH_INFO: `/v3/projects/208341bc505d4908a3287cfe957f5537/users/60ba33758cea4484ac01954dd499e5b5/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.611868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc07ee-0c1a-422f-9ddd-57fee2f11cb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.614128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc07ee-0c1a-422f-9ddd-57fee2f11cb0 service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.614656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc07ee-0c1a-422f-9ddd-57fee2f11cb0 service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.615089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc07ee-0c1a-422f-9ddd-57fee2f11cb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.625427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fcbff-d25f-427b-9e05-4252203e314b admin admin] RBAC: Authorizing `identity:create_grant(project_id=208341bc505d4908a3287cfe957f5537, user_id=60ba33758cea4484ac01954dd499e5b5, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.628131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fcbff-d25f-427b-9e05-4252203e314b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.683458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc07ee-0c1a-422f-9ddd-57fee2f11cb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.685115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc07ee-0c1a-422f-9ddd-57fee2f11cb0 service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.693425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1189/2354] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:08:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:08:00.694822 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.695244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.695590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.728657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1166/2355] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:08:00 2021] PUT /identity/v3/projects/208341bc505d4908a3287cfe957f5537/users/60ba33758cea4484ac01954dd499e5b5/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:00.732128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] MFA Rules not processed for user `6f49b48946d2415d977ae6262f91ae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:00.733389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:00.738543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.738994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.739400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.771042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] MFA Rules not processed for user `60ba33758cea4484ac01954dd499e5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:00.772612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:00.811316 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1190/2356] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:00 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:00.822142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.823676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:00.843475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1167/2357] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:00 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:08:00.848145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:00.888630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0c01c-fb54-4a57-a836-faf013c53f90 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.892638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.893307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.893594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.893875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.903875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.905417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:00.912516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed511-4153-40fe-9dd9-953eed91f536 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:00.915439 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1191/2358] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:00 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:00.917868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:00.918471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:00.918788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:00.919069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:00.919755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:00.921685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.227162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1168/2359] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:08:00 2021] POST /identity/v3/projects => generated 377 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:08:01.230837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.242088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19a94c-139a-4672-bcd2-a518847a8bcb service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.295705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.297531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:01.306299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.307602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.308230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.308230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.308901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:01.310862 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.363243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd7ee-e2d2-414b-81f6-b371eaad948a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.367049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9255-7599-475a-af36-891c4227072b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.367694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9255-7599-475a-af36-891c4227072b service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.367979 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9255-7599-475a-af36-891c4227072b service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.368258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9255-7599-475a-af36-891c4227072b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.426217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e9255-7599-475a-af36-891c4227072b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:01.427619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e9255-7599-475a-af36-891c4227072b service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.439152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1169/2360] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:01 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:08:01.442079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1192/2361] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:08:01 2021] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:08:01.448458 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9255-7599-475a-af36-891c4227072b service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.468033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9255-7599-475a-af36-891c4227072b service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.472102 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.476865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.476865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.476865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.476865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:01.476865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.486610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1170/2362] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:08:01.491066 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.501778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7deb8-f298-4a39-80b0-07190d461b02 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.506401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.507325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.507604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.508382 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] PATH_INFO: `/v3/projects/deb6545536404383b25958c2aa5462e6/users/26582ed5c4584b48b9866c5e72fe715f/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.525287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb6545536404383b25958c2aa5462e6, user_id=26582ed5c4584b48b9866c5e72fe715f, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:01.528208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.624567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.625009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1193/2363] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:08:01 2021] PUT /identity/v3/projects/deb6545536404383b25958c2aa5462e6/users/26582ed5c4584b48b9866c5e72fe715f/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:01.638361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877c90-d5d8-466e-b5e3-044efd2f37dd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.714432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9a9d2-c977-4e3f-8a62-af5eb58f1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.715199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9a9d2-c977-4e3f-8a62-af5eb58f1cff admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.715486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9a9d2-c977-4e3f-8a62-af5eb58f1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.715768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9a9d2-c977-4e3f-8a62-af5eb58f1cff admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.726107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9a9d2-c977-4e3f-8a62-af5eb58f1cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:01.726107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9a9d2-c977-4e3f-8a62-af5eb58f1cff admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.734166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1171/2364] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:01 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:08:01.738534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.750596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec85988-d49d-4e70-a9e9-f0ccf8661c10 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.756538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.757431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.757953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.758235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] PATH_INFO: `/v3/projects/deb6545536404383b25958c2aa5462e6/users/26582ed5c4584b48b9866c5e72fe715f/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.760464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb6545536404383b25958c2aa5462e6, user_id=26582ed5c4584b48b9866c5e72fe715f, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:01.763257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:01.777566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1194/2365] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:08:01 2021] PUT /identity/v3/projects/deb6545536404383b25958c2aa5462e6/users/26582ed5c4584b48b9866c5e72fe715f/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:01.795727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73bd4-99d6-429f-bd43-9f9b55e22a13 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.796255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73bd4-99d6-429f-bd43-9f9b55e22a13 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.796618 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73bd4-99d6-429f-bd43-9f9b55e22a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:01.832559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-38a73bd4-99d6-429f-bd43-9f9b55e22a13 None None] MFA Rules not processed for user `26582ed5c4584b48b9866c5e72fe715f`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:01.833909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-38a73bd4-99d6-429f-bd43-9f9b55e22a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:01.910186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1172/2366] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:01 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:01.928651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:01.982081 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ca07-3401-46ad-be02-2a7695d6df4e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:01.987925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:01.987925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:01.987925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:01.987925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:02.066498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:02.068583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:02.078311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1195/2367] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:02.751263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c29a7-f8f7-4e70-8274-52090056f3c1 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:02.751511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c29a7-f8f7-4e70-8274-52090056f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:02.751817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c29a7-f8f7-4e70-8274-52090056f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:02.771675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-eb4c29a7-f8f7-4e70-8274-52090056f3c1 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:02.773094 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-eb4c29a7-f8f7-4e70-8274-52090056f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:02.839306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1173/2368] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:08:02 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:02.863503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:02.933394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce69b9-8edf-4dbe-a9d6-86ba08bb8b21 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:02.938473 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:02.939159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:02.939459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:02.939890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:02.951838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:02.953710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:02.962094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1196/2369] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:08:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:08:03.024295 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93c07-bede-4237-91ee-36b0bfe8d164 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:03.024826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93c07-bede-4237-91ee-36b0bfe8d164 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:03.025137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93c07-bede-4237-91ee-36b0bfe8d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:03.045794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-06f93c07-bede-4237-91ee-36b0bfe8d164 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:03.047166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-06f93c07-bede-4237-91ee-36b0bfe8d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:03.055978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1174/2370] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:08:03 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:03.070687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:03.083389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e091a-c202-44e6-98b9-baa72b273fa3 service swift] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:03.089206 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:03.089877 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:03.090304 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:03.090407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:03.100189 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:03.101895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:03.111717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1197/2371] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:08:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:08:04.633554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:04.635194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:04.635881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:04.656822 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:04.658197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:04.669803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1175/2372] 10.222.0.73 () {58 vars in 968 bytes} [Fri Aug 27 04:08:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:04.726876 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:04.745532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066c92-e156-47dc-9443-14ca8804d047 service swift] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:04.763200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:04.764290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:04.764754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:04.765204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:04.775091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:04.777932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:04.789930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1198/2373] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:08:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:08:05.733498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:05.748208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286e4d1-246d-4f9f-9169-87db25a086f7 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:05.752792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:05.753594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:05.754117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:05.754661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:05.850644 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:05.852354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:05.864074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1176/2374] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:05 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:08.811770 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:08.825133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838719-26ab-4540-adb1-3169647b2fac service swift] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:08.833036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaa746-d612-4f13-ab85-505868a7e25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:08.833987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa746-d612-4f13-ab85-505868a7e25c service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:08.834270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa746-d612-4f13-ab85-505868a7e25c service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:08.834551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa746-d612-4f13-ab85-505868a7e25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:08.846601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaa746-d612-4f13-ab85-505868a7e25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:08.848079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaa746-d612-4f13-ab85-505868a7e25c service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:08.865364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1199/2375] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:08 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:15.722982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:15.724598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:15.806186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2dd57-d2f7-4e89-aca5-e2611850be1b service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:15.812754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:15.814931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:15.814931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:15.814931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] PATH_INFO: `/v3/users/7037ec4eba3d404487514e3bee56a21e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:15.815923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7037ec4eba3d404487514e3bee56a21e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:15.817997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:16.076173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7037ec4eba3d404487514e3bee56a21e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:16.172871 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7037ec4eba3d404487514e3bee56a21e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:16.185629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7037ec4eba3d404487514e3bee56a21e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:16.186637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7037ec4eba3d404487514e3bee56a21e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:16.186929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7037ec4eba3d404487514e3bee56a21e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:16.200049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1177/2376] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:08:15 2021] DELETE /identity/v3/users/7037ec4eba3d404487514e3bee56a21e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:16.204618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:16.205178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:16.205178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:16.224359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:16.225647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:16.283216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1200/2377] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:16.293817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:16.295268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:16.351563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfded1-bcfa-4013-84ec-279a3b5a72df admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:16.355757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:16.356405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:16.356689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:16.356966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:16.366679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:16.368118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:16.378442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1178/2378] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:16.714054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:16.715709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:16.731795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e17e88-0f9d-415c-b310-176c3760139c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:16.747838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:16.748634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:16.748915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:16.749328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] PATH_INFO: `/v3/projects/769d70d40946487c899a78bcec6dca8f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:16.754233 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769d70d40946487c899a78bcec6dca8f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:16.756543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:16.794186 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:16.795818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:16.808345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfbdb5-2e72-42fc-8f4e-40d6dc8b779e service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:16.812283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:16.813009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:16.813361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:16.813709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:16.815587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:16.886599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:16.888026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:16.899026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1179/2379] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:08:16.899902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:16.908503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746886ed-05eb-4576-b89a-ec53a1c804a9 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:16.912394 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:16.913055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:16.913338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:16.913616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:16.915405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:16.979810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:16.981177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:16.991124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1180/2380] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:16 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:17.026442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769d70d40946487c899a78bcec6dca8f', 'request_id': 'req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:17.280445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769d70d40946487c899a78bcec6dca8f', 'request_id': 'req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:17.286662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769d70d40946487c899a78bcec6dca8f', 'request_id': 'req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:17.299724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] The token cache is being invalidate because project 769d70d40946487c899a78bcec6dca8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:08:17.300179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:17.301069 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:17.303007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1201/2381] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:08:16 2021] DELETE /identity/v3/projects/769d70d40946487c899a78bcec6dca8f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:18.073076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:18.082694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbaff8-fa4c-42a7-86fa-46047f9a6f29 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:18.137454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:18.138042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:18.138327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:18.138642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:18.140378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:18.209678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:18.211148 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff7b8e-6dbc-47c8-a6bb-1d034f650e6e service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:18.222825 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1181/2382] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:20.118504 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:20.121126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:20.227729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0490c3-0fc5-4874-ba22-9adf3bc1d985 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:20.232297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:20.233226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:20.233542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:20.233825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] PATH_INFO: `/v3/users/8530323ecd9148f8b90558e644081573` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:20.235479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8530323ecd9148f8b90558e644081573)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:20.237457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:20.512530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8530323ecd9148f8b90558e644081573'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:20.514379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8530323ecd9148f8b90558e644081573'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:20.614521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8530323ecd9148f8b90558e644081573'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:20.615736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8530323ecd9148f8b90558e644081573'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:20.635949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8530323ecd9148f8b90558e644081573'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:20.657447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1202/2383] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:08:20 2021] DELETE /identity/v3/users/8530323ecd9148f8b90558e644081573 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:20.662073 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:20.662622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:20.662722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:20.687077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:20.688338 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:20.755863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1182/2384] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:20.765800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:20.767363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:20.835826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44008dec-1139-42e8-a523-34c35f0a3287 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:20.841029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:20.841837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:20.842190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:20.842542 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:20.855957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:20.857861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:20.870416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1203/2385] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:21.483464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:21.484454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:21.505997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e169f-258d-4216-a802-dccdcde5e198 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:21.512029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:21.512914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:21.513196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:21.513505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] PATH_INFO: `/v3/projects/613b5098ac494f47b44a8fefb6c538d4` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:21.514809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613b5098ac494f47b44a8fefb6c538d4)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:21.516765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:21.673321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613b5098ac494f47b44a8fefb6c538d4', 'request_id': 'req-2801cadf-1232-4959-945a-835f3769cfe0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:21.679742 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613b5098ac494f47b44a8fefb6c538d4', 'request_id': 'req-2801cadf-1232-4959-945a-835f3769cfe0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:21.758361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613b5098ac494f47b44a8fefb6c538d4', 'request_id': 'req-2801cadf-1232-4959-945a-835f3769cfe0'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:21.770296 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] The token cache is being invalidate because project 613b5098ac494f47b44a8fefb6c538d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:08:21.770610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:21.771307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-2801cadf-1232-4959-945a-835f3769cfe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:21.772884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1183/2386] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:08:21 2021] DELETE /identity/v3/projects/613b5098ac494f47b44a8fefb6c538d4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:21.777682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:21.787612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8e9bc-2aed-4a93-8acf-06d251667547 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:21.855659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:21.856536 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:21.856816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:21.857086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] PATH_INFO: `/v3/users/60ba33758cea4484ac01954dd499e5b5` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:21.858283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ba33758cea4484ac01954dd499e5b5)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:21.860250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:22.120262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ba33758cea4484ac01954dd499e5b5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:22.120957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ba33758cea4484ac01954dd499e5b5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:22.196270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ba33758cea4484ac01954dd499e5b5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:22.197212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ba33758cea4484ac01954dd499e5b5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:22.213366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-f54b6a4b-188a-487e-9842-ef27e363fd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ba33758cea4484ac01954dd499e5b5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:22.230660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1204/2387] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:08:21 2021] DELETE /identity/v3/users/60ba33758cea4484ac01954dd499e5b5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:22.547516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871ec9f-a3ea-495b-a0d7-43809491da26 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:22.547516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871ec9f-a3ea-495b-a0d7-43809491da26 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:22.547516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871ec9f-a3ea-495b-a0d7-43809491da26 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:22.547516 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1184/2388] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:08:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:08:22.556996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:22.557916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:22.559101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:22.610788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:22.612097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:22.692397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1205/2389] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:08:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:22.713248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871ec9f-a3ea-495b-a0d7-43809491da26 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:22.716414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b871ec9f-a3ea-495b-a0d7-43809491da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:22.793339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871ec9f-a3ea-495b-a0d7-43809491da26 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:22.798285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06adf-8e0b-40ee-a163-35ed8850e6c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:22.799428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06adf-8e0b-40ee-a163-35ed8850e6c4 service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:22.799428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06adf-8e0b-40ee-a163-35ed8850e6c4 service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:22.799907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06adf-8e0b-40ee-a163-35ed8850e6c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:22.812863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06adf-8e0b-40ee-a163-35ed8850e6c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:22.814494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06adf-8e0b-40ee-a163-35ed8850e6c4 service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:22.827573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1185/2390] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:23.013253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:23.014794 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:23.082172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcbbec-927b-4074-b172-dff926d25279 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:23.086984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:23.087997 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:23.088280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:23.088556 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] PATH_INFO: `/v3/projects/208341bc505d4908a3287cfe957f5537` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:23.089749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] RBAC: Authorizing `identity:delete_project(project_id=208341bc505d4908a3287cfe957f5537)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:23.091734 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:23.147479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe5b5-4b70-4646-9ab3-bde643268b20 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:23.147839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe5b5-4b70-4646-9ab3-bde643268b20 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:23.148160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe5b5-4b70-4646-9ab3-bde643268b20 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:23.150629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1186/2391] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:08:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:08:23.155925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:23.156207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:23.156481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:23.177376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:23.186780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:23.230832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1187/2392] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:08:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:08:23.242993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:23.245327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:23.256076 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2999b-761c-4843-97cd-d5d53c3df5c9 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:23.260845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:23.261484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:23.261760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:23.262078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:23.269281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:23.270760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:23.278232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1188/2393] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:23 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:08:23.316178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208341bc505d4908a3287cfe957f5537', 'request_id': 'req-850e4363-e72f-449e-b916-b38cab50618d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:23.356966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:23.358465 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:23.412752 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208341bc505d4908a3287cfe957f5537', 'request_id': 'req-850e4363-e72f-449e-b916-b38cab50618d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:23.420491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208341bc505d4908a3287cfe957f5537', 'request_id': 'req-850e4363-e72f-449e-b916-b38cab50618d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:23.430845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88e25-6f4a-4d28-9554-f6f021f71bd0 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:23.435359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] The token cache is being invalidate because project 208341bc505d4908a3287cfe957f5537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:08:23.435953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:23.437164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:23.439484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1206/2394] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:08:23 2021] DELETE /identity/v3/projects/208341bc505d4908a3287cfe957f5537 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:23.443603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:23.451426 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:23.495604 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:23.496432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:23.496976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:23.497302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:23.499255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:23.512962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:23.514743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:23.520120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4363-e72f-449e-b916-b38cab50618d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:23.525704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:23.535818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:23.535818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:23.535818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] PATH_INFO: `/v3/users/26582ed5c4584b48b9866c5e72fe715f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:23.536218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1189/2395] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:23 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:08:23.536343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=26582ed5c4584b48b9866c5e72fe715f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:23.536343 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:23.850333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26582ed5c4584b48b9866c5e72fe715f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:23.851064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26582ed5c4584b48b9866c5e72fe715f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:24.072608 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26582ed5c4584b48b9866c5e72fe715f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:24.073730 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26582ed5c4584b48b9866c5e72fe715f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:24.090484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-53ce73a8-3aa8-4f69-be2b-1fd09a739aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26582ed5c4584b48b9866c5e72fe715f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:24.122819 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1207/2396] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:08:23 2021] DELETE /identity/v3/users/26582ed5c4584b48b9866c5e72fe715f => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:08:24.784449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:24.805866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95804360-8a6d-4a5d-b4ed-8ef2dbd8854a service placement] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:24.889652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:24.890520 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:24.901582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:24.901892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] PATH_INFO: `/v3/projects/deb6545536404383b25958c2aa5462e6` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:24.903524 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb6545536404383b25958c2aa5462e6)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:24.905528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.016855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb6545536404383b25958c2aa5462e6', 'request_id': 'req-c57e416e-da39-4c30-9616-e2623c25a5cf'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:25.023264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb6545536404383b25958c2aa5462e6', 'request_id': 'req-c57e416e-da39-4c30-9616-e2623c25a5cf'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:25.207808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb6545536404383b25958c2aa5462e6', 'request_id': 'req-c57e416e-da39-4c30-9616-e2623c25a5cf'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:25.220445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] The token cache is being invalidate because project deb6545536404383b25958c2aa5462e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:08:25.220741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:25.221436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c57e416e-da39-4c30-9616-e2623c25a5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:08:25.223123 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1190/2397] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:08:24 2021] DELETE /identity/v3/projects/deb6545536404383b25958c2aa5462e6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:25.229683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.230173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.230265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.249026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:25.250219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:25.307366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1208/2398] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:25.315348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.315712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.316025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.334949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:25.336227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:25.344282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1191/2399] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:25.351826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:25.361674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078b77d-ef65-4374-ae45-d84ffd43fbb6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:25.366438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:25.367140 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.367413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.367691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.368959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:08:25.369272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:25.370887 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.382633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1209/2400] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:08:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:08:25.389268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:25.398590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4247-d997-49fc-bbcc-ee48bb75ce56 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:25.406522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:25.406522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.406522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.406522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.406922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:25.407542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.489461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1192/2401] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:08:25 2021] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:08:25.494091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:25.504071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd988-e12c-4d31-adc3-804247cf6e54 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:25.564534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:25.565214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.565559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.565839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.566577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:25.568507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.680834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1210/2402] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:08:25 2021] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:08:25.684938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:25.695752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73180-081a-450f-8457-aa580690b6b4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:25.701626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:25.702287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.702587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.702873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.703586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:25.705166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.717861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1193/2403] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:25 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:08:25.725134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:25.735498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312b8ee-1136-4138-ade3-a6ac4618c1a6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:25.740241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afb82-4f98-48c3-a42f-fe34c195a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:25.740911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afb82-4f98-48c3-a42f-fe34c195a06c admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.741192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afb82-4f98-48c3-a42f-fe34c195a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.741520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afb82-4f98-48c3-a42f-fe34c195a06c admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.742253 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afb82-4f98-48c3-a42f-fe34c195a06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:25.744093 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afb82-4f98-48c3-a42f-fe34c195a06c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.754336 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1211/2404] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:08:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:08:25.760469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:25.770589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1b5ce-1f25-421a-a712-7a98e60131bd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:25.775879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:25.776925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.777206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.777480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] PATH_INFO: `/v3/projects/a65ba74164e2464cab37a8459816ebab/users/bc5d70235d054703a69d76fd54daf683/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.803483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65ba74164e2464cab37a8459816ebab, user_id=bc5d70235d054703a69d76fd54daf683, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:25.811174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:25.916574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1194/2405] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:08:25 2021] PUT /identity/v3/projects/a65ba74164e2464cab37a8459816ebab/users/bc5d70235d054703a69d76fd54daf683/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:08:25.921994 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2374-25c1-4910-9108-aa7db6d16d79 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:25.923266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2374-25c1-4910-9108-aa7db6d16d79 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:25.923266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2374-25c1-4910-9108-aa7db6d16d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:25.942045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-248e2374-25c1-4910-9108-aa7db6d16d79 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:25.943218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-248e2374-25c1-4910-9108-aa7db6d16d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:26.008564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1212/2406] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:26.020383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:26.023408 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:26.086360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411e60-50cf-426b-b0a7-034fc2d8acd3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:26.091883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:26.092650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:26.092856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:26.093135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:26.103813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:26.105324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:26.116632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1195/2407] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:27.450800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:27.451347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:27.451347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:27.478686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] MFA Rules not processed for user `bc5d70235d054703a69d76fd54daf683`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:27.479884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:27.549264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1213/2408] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:27 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:27.561147 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:27.564048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:27.633812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4562f-cff8-4ba3-924e-296990f2b491 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:27.638842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaccb3-1218-4f64-bf67-21367fb63fdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:27.639498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaccb3-1218-4f64-bf67-21367fb63fdb service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:27.640004 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaccb3-1218-4f64-bf67-21367fb63fdb service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:27.640426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaccb3-1218-4f64-bf67-21367fb63fdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:27.649263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaccb3-1218-4f64-bf67-21367fb63fdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:27.652090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaccb3-1218-4f64-bf67-21367fb63fdb service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:27.666746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1196/2409] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:27 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:27.749585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:27.751111 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:27.809574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3b64-1895-486f-9c1e-5dc19a6f0ec2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:27.813255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:27.813910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:27.814191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:27.814465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:27.816416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:27.875442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:27.876843 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:27.887170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1214/2410] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:27 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:27.944051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec51f-2a2d-4215-a3de-c1ef4c6ad00f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:27.944422 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec51f-2a2d-4215-a3de-c1ef4c6ad00f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:27.945183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec51f-2a2d-4215-a3de-c1ef4c6ad00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:27.963178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-424ec51f-2a2d-4215-a3de-c1ef4c6ad00f None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:27.964383 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-424ec51f-2a2d-4215-a3de-c1ef4c6ad00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:28.022152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1197/2411] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:08:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:28.035539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:28.036976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:28.107194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1378b-aa8a-44be-be4d-d4add61a644b service glance] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:28.112506 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:28.113163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:28.113444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:28.113719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:28.123041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:28.124640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:28.133672 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1215/2412] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:08:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:08:30.614018 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:30.614608 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:30.614608 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:30.632670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] MFA Rules not processed for user `bc5d70235d054703a69d76fd54daf683`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:08:30.633883 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:30.642032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1198/2413] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:08:30 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:08:30.905867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:30.916357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e2d1f-1cf2-4f22-91ca-75ebdbdf0b4e service swift] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:30.923643 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:30.924401 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:30.925018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:30.925363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:30.927370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:30.938252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:30.939821 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:30.949342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1216/2414] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:08:52.971490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:52.973708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:52.986230 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eb348-7f77-4529-b1a8-bcc1dbb989d2 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:52.990046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:52.990718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:52.991002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:52.991279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:52.993030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:53.003909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:53.005382 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:53.013594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1199/2415] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:52 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:08:53.831986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:08:53.836178 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:53.934268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b9ebe-490e-4650-b74c-a2262cf16993 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:08:53.940158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:08:53.940832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:08:53.946143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:08:53.946143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:08:53.946143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:08:53.956611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:08:53.958231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbee2-7a22-4c1b-905f-0fd6f7b5552e service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:08:53.980508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1217/2416] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:08:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:09:01.576084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:01.589659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484d99d-d49a-4f9a-b38b-c3b72e624091 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:01.595143 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:01.595778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:01.596062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:01.596339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:01.598075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:01.610893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:01.612454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:01.623565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1200/2417] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:09:10.202399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:10.202978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:10.203177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:10.226147 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:10.227830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:10.237742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1218/2418] 10.222.0.73 () {58 vars in 968 bytes} [Fri Aug 27 04:09:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:10.265912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:10.278824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd487f-7d73-448f-bbba-833704669f28 service nova] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:10.284544 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14fed-8c42-4b82-a86c-d3d1ff59889e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:10.285176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14fed-8c42-4b82-a86c-d3d1ff59889e service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:10.285459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14fed-8c42-4b82-a86c-d3d1ff59889e service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:10.285835 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14fed-8c42-4b82-a86c-d3d1ff59889e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:10.297554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c14fed-8c42-4b82-a86c-d3d1ff59889e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:10.299280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c14fed-8c42-4b82-a86c-d3d1ff59889e service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:10.309650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1201/2419] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:09:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:09:12.879389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:12.881030 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:12.896363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e519-0ef9-4af0-9f15-2aa60b664158 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:12.901483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:12.902345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:12.902703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:12.902981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] PATH_INFO: `/v3/users/cf7d4e758e6e4d2482fdfe4bc3d229c0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:12.904190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7d4e758e6e4d2482fdfe4bc3d229c0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:12.906154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:13.118259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7d4e758e6e4d2482fdfe4bc3d229c0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:13.118986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7d4e758e6e4d2482fdfe4bc3d229c0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:13.230824 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7d4e758e6e4d2482fdfe4bc3d229c0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:13.231374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7d4e758e6e4d2482fdfe4bc3d229c0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:13.245972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7d4e758e6e4d2482fdfe4bc3d229c0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:13.261357 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1219/2420] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:09:12 2021] DELETE /identity/v3/users/cf7d4e758e6e4d2482fdfe4bc3d229c0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:13.266003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:13.266490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:13.266635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:13.284297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:13.285513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:13.344009 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1202/2421] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:13.355571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:13.357067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:13.418347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8add0-cb6c-4c56-aa7c-c27a33412e77 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:13.422444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7fc5-f36d-4a33-885f-5dc153140687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:13.423133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7fc5-f36d-4a33-885f-5dc153140687 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:13.423421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7fc5-f36d-4a33-885f-5dc153140687 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:13.423700 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7fc5-f36d-4a33-885f-5dc153140687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:13.437878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7fc5-f36d-4a33-885f-5dc153140687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:13.439374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7fc5-f36d-4a33-885f-5dc153140687 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:13.450820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1220/2422] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:09:13.899183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:13.902607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:13.906243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:13.906243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:13.906243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:13.921550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149dce-bd93-4ca7-9957-4363143100e5 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:13.926443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] MFA Rules not processed for user `bc5d70235d054703a69d76fd54daf683`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:13.927696 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:13.933577 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:13.934469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:13.934776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:13.935052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] PATH_INFO: `/v3/projects/be4e016c227c4712b72df61014694ef1` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:13.936304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4e016c227c4712b72df61014694ef1)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:13.938260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:13.991134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1221/2423] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:13 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:09:14.045216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4e016c227c4712b72df61014694ef1', 'request_id': 'req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.052055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4e016c227c4712b72df61014694ef1', 'request_id': 'req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.105173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4e016c227c4712b72df61014694ef1', 'request_id': 'req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.116510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] The token cache is being invalidate because project be4e016c227c4712b72df61014694ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:09:14.116708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.117402 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.119245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1203/2424] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:09:13 2021] DELETE /identity/v3/projects/be4e016c227c4712b72df61014694ef1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:14.123878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:14.136638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178fd95-1428-4d3c-9d6a-76a79b376251 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:14.202057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:14.203404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:14.203864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:14.204286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] PATH_INFO: `/v3/users/6f49b48946d2415d977ae6262f91ae0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:14.206155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f49b48946d2415d977ae6262f91ae0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:14.209570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:14.375570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f49b48946d2415d977ae6262f91ae0e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.376210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f49b48946d2415d977ae6262f91ae0e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.447655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f49b48946d2415d977ae6262f91ae0e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.448289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f49b48946d2415d977ae6262f91ae0e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.461515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-01774aff-7c66-418a-a058-95afb72e2df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f49b48946d2415d977ae6262f91ae0e'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:14.475159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1222/2425] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:09:14 2021] DELETE /identity/v3/users/6f49b48946d2415d977ae6262f91ae0e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:14.937483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:14.939337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:14.954198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d66cd-77e8-4054-ad5a-7a862cf6a413 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:15.036428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:15.051913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:15.051913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:15.051913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] PATH_INFO: `/v3/projects/bf9583029d5a486198820501ef6b59e5` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:15.051913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9583029d5a486198820501ef6b59e5)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:15.051913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:15.414827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9583029d5a486198820501ef6b59e5', 'request_id': 'req-68203cb0-356b-4dc8-b534-b4923286d325'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:15.421218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9583029d5a486198820501ef6b59e5', 'request_id': 'req-68203cb0-356b-4dc8-b534-b4923286d325'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:15.555574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9583029d5a486198820501ef6b59e5', 'request_id': 'req-68203cb0-356b-4dc8-b534-b4923286d325'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:15.567969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] The token cache is being invalidate because project bf9583029d5a486198820501ef6b59e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:09:15.568254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:15.568895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-68203cb0-356b-4dc8-b534-b4923286d325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:15.570433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1204/2426] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:09:14 2021] DELETE /identity/v3/projects/bf9583029d5a486198820501ef6b59e5 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:15.576720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:15.577264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:15.577264 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:15.596580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:15.597837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:15.658607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1223/2427] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:15.667467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:15.667753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:15.668035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:15.687208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:15.688423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:15.696372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1205/2428] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:15.700798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:15.711119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f497a0-0502-4fc3-bcca-d4165f3119f8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:15.716809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:15.717628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:15.718119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:15.718454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:15.719263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:09:15.719620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:15.721319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:15.734153 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1224/2429] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:09:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:09:15.738975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:15.750044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ed2b0-3024-4de7-ad29-d32fd694545e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:15.755010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:15.755685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:15.755971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:15.756255 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:15.756976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:15.758925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:15.859488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1206/2430] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:09:15 2021] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:15.863491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:15.876333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8b478-5cdf-4a87-99fb-ae1161356c68 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:15.937124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:15.937805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:15.938085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:15.938361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:15.939113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:15.941075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.042522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1225/2431] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:09:15 2021] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:16.046881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.057481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d919-a4e5-46b3-a659-877b8196c9cd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.062181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.062878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.063163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.063444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.064168 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.065758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.076688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1207/2432] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:16.080798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.092298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f248-1ed2-4707-afe2-fd8e21a97556 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.097160 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e46663-6c9e-4335-ae71-37b110024b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.097839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e46663-6c9e-4335-ae71-37b110024b87 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.098127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e46663-6c9e-4335-ae71-37b110024b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.098407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e46663-6c9e-4335-ae71-37b110024b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.099173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e46663-6c9e-4335-ae71-37b110024b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.100792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e46663-6c9e-4335-ae71-37b110024b87 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.112529 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1226/2433] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:16.116853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.127054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0b95e-d397-4859-97c6-974d23ea6805 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.132206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.133085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.133370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.133650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] PATH_INFO: `/v3/projects/7239a15b318b45e8af2179302fbb41d4/users/fb298e6ad6b541b097dbdd534b169f3d/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.148657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7239a15b318b45e8af2179302fbb41d4, user_id=fb298e6ad6b541b097dbdd534b169f3d, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.152153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.258898 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1208/2434] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:16 2021] PUT /identity/v3/projects/7239a15b318b45e8af2179302fbb41d4/users/fb298e6ad6b541b097dbdd534b169f3d/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:16.270694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.270981 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.271254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.299899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] MFA Rules not processed for user `fb298e6ad6b541b097dbdd534b169f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:16.301360 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:16.366756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1227/2435] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:16 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:16.371331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.437344 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e24fe-ac4d-4886-8995-30c795c6e7e3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.442417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.443110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.443396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.443675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.444377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.446276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.528278 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1209/2436] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:09:16 2021] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:16.532526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.543882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e500d8-abe5-42f9-a60a-316e0b251e66 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.610786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.611477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.611640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.611913 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.612598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.614516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.731210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1228/2437] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:09:16 2021] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:16.735276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.746775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d7aba-fd31-4ef2-a4e9-1213cbbf23f3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.751429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.752095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.752372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.752677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.753439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.755085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.769047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1210/2438] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:16 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:16.773381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.783812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52e83-ad8f-40bc-89f2-151fac6b2f1a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:16.788617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:16.789501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:16.789785 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:16.790057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] PATH_INFO: `/v3/projects/ad81128e739d4b8c983251b052868844/users/d91ea40912d747beabc1e040d96fcbc2/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:16.805737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad81128e739d4b8c983251b052868844, user_id=d91ea40912d747beabc1e040d96fcbc2, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:16.809076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:16.922051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1229/2439] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:16 2021] PUT /identity/v3/projects/ad81128e739d4b8c983251b052868844/users/d91ea40912d747beabc1e040d96fcbc2/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:16.926598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:16.937848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43f66d-26ad-409a-b828-9ef1e6a23430 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:17.001118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa37da-66e4-4af3-be77-41738cfe7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:17.001815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa37da-66e4-4af3-be77-41738cfe7f86 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:17.002092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa37da-66e4-4af3-be77-41738cfe7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:17.002366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa37da-66e4-4af3-be77-41738cfe7f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:17.003136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa37da-66e4-4af3-be77-41738cfe7f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:17.004759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa37da-66e4-4af3-be77-41738cfe7f86 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:17.016434 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1211/2440] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:16 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:09:17.020607 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:17.031312 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8b58-46c6-4880-87e4-411d670a3740 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:17.036027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:17.036924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:17.037205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:17.037483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] PATH_INFO: `/v3/projects/ad81128e739d4b8c983251b052868844/users/d91ea40912d747beabc1e040d96fcbc2/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:17.039493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad81128e739d4b8c983251b052868844, user_id=d91ea40912d747beabc1e040d96fcbc2, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:17.042199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:17.053072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1230/2441] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:17 2021] PUT /identity/v3/projects/ad81128e739d4b8c983251b052868844/users/d91ea40912d747beabc1e040d96fcbc2/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:17.064841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:17.065389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:17.065389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:17.094725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] MFA Rules not processed for user `d91ea40912d747beabc1e040d96fcbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:17.096008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:17.175163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1212/2442] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:17 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:17.186683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:17.188520 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:17.249617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dbd90-97bc-4b19-9928-9311c96aa811 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:17.254041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f269-4a89-4c10-84ac-d5249276a115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:17.254871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f269-4a89-4c10-84ac-d5249276a115 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:17.255270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f269-4a89-4c10-84ac-d5249276a115 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:17.255650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f269-4a89-4c10-84ac-d5249276a115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:17.268828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2f269-4a89-4c10-84ac-d5249276a115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:17.270622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2f269-4a89-4c10-84ac-d5249276a115 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:17.282976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1231/2443] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:17 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:09:17.671284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:17.761373 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2838-201c-4c3f-bf8c-5752bfbcce8f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:17.769017 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:17.770313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:17.770849 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:17.771321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] PATH_INFO: `/v3/users/fb298e6ad6b541b097dbdd534b169f3d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:17.773152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb298e6ad6b541b097dbdd534b169f3d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:17.776727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:18.068609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb298e6ad6b541b097dbdd534b169f3d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:18.182812 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb298e6ad6b541b097dbdd534b169f3d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:18.195766 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb298e6ad6b541b097dbdd534b169f3d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:18.196496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb298e6ad6b541b097dbdd534b169f3d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:18.197200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb298e6ad6b541b097dbdd534b169f3d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:18.210462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1213/2444] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:09:17 2021] DELETE /identity/v3/users/fb298e6ad6b541b097dbdd534b169f3d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:18.215359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:18.215860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:18.216039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:18.236276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:18.237324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:18.302683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1232/2445] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:09:18.312903 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:18.315321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:18.378598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90df49-934a-4886-abca-911fa0f62bfe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:18.382587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:18.383260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:18.383543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:18.383820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:18.393767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:18.395266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:18.407599 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1214/2446] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:09:19.017806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:19.019599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:19.033028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ccc14-454f-4da1-a103-d8ab2b9d02b7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:19.037902 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:19.039400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:19.039971 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:19.040353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] PATH_INFO: `/v3/projects/7239a15b318b45e8af2179302fbb41d4` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:19.042620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7239a15b318b45e8af2179302fbb41d4)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:19.049535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:19.170868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7239a15b318b45e8af2179302fbb41d4', 'request_id': 'req-a898eb3e-5298-42ab-958e-cc768b201999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.287342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7239a15b318b45e8af2179302fbb41d4', 'request_id': 'req-a898eb3e-5298-42ab-958e-cc768b201999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.295134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7239a15b318b45e8af2179302fbb41d4', 'request_id': 'req-a898eb3e-5298-42ab-958e-cc768b201999'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.309267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] The token cache is being invalidate because project 7239a15b318b45e8af2179302fbb41d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:09:19.309644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.310342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.312099 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1233/2447] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:09:19 2021] DELETE /identity/v3/projects/7239a15b318b45e8af2179302fbb41d4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:19.316288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:19.326598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea514-cbf9-4566-b702-99efcde1266b service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:19.413035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:19.419896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:19.419896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:19.419896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] PATH_INFO: `/v3/users/d91ea40912d747beabc1e040d96fcbc2` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:19.419896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91ea40912d747beabc1e040d96fcbc2)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:19.420632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:19.753064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91ea40912d747beabc1e040d96fcbc2'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.871965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91ea40912d747beabc1e040d96fcbc2'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.885496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91ea40912d747beabc1e040d96fcbc2'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.886233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91ea40912d747beabc1e040d96fcbc2'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.886991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0df16277-8461-4e4a-99a6-8babd9508605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91ea40912d747beabc1e040d96fcbc2'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:19.899755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1215/2448] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:09:19 2021] DELETE /identity/v3/users/d91ea40912d747beabc1e040d96fcbc2 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:20.351146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:20.352760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:20.377064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898eb3e-5298-42ab-958e-cc768b201999 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:20.436652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:20.437830 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:20.438113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:20.438398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] PATH_INFO: `/v3/projects/ad81128e739d4b8c983251b052868844` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:20.439586 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad81128e739d4b8c983251b052868844)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:20.441479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:20.561839 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad81128e739d4b8c983251b052868844', 'request_id': 'req-bcfac06b-04ab-4361-83d7-af42c8407ad3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:20.716215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad81128e739d4b8c983251b052868844', 'request_id': 'req-bcfac06b-04ab-4361-83d7-af42c8407ad3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:20.722245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad81128e739d4b8c983251b052868844', 'request_id': 'req-bcfac06b-04ab-4361-83d7-af42c8407ad3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:20.733679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] The token cache is being invalidate because project ad81128e739d4b8c983251b052868844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:09:20.737309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:20.737309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-bcfac06b-04ab-4361-83d7-af42c8407ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:20.737309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1234/2449] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:09:20 2021] DELETE /identity/v3/projects/ad81128e739d4b8c983251b052868844 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:20.742246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:20.742773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:20.742997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:20.762460 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:20.763693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:20.835021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1216/2450] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:20.841896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:20.842185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:20.842469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:20.867341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:20.868656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:20.878107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1235/2451] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:09:20.883329 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:20.893500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad51a-0141-4c7d-aa73-ca37e6d0157a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:20.898197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:20.898896 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:20.899180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:20.899457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:20.900176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:09:20.900483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:20.902083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:20.913990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1217/2452] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:09:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:09:20.920985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:20.935403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b22d3-ebec-4d43-88c3-7752df1e349c None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:20.942307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:20.943007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:20.943286 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:20.943559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:20.944262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:20.946166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:21.112225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1236/2453] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:09:20 2021] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:09:21.116357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:21.126841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf03ff-ae11-4518-b35c-d6bfe32b63c4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:21.186448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:21.187163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:21.187445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:21.187717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:21.188414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:21.190341 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:21.308648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1218/2454] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:09:21 2021] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:21.312894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:21.323705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a10eb-3542-4843-b927-2ee5875f6350 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:21.328896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:21.329596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:21.329918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:21.330193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:21.330944 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:21.332698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:21.343884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1237/2455] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:21.348212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:21.358776 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d9319-6145-4ead-a2e5-99fbe25fc11f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:21.363347 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb9646-e909-4cbd-99e2-23e0cb49b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:21.363977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9646-e909-4cbd-99e2-23e0cb49b304 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:21.364256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9646-e909-4cbd-99e2-23e0cb49b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:21.364532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9646-e909-4cbd-99e2-23e0cb49b304 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:21.365246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb9646-e909-4cbd-99e2-23e0cb49b304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:21.366920 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb9646-e909-4cbd-99e2-23e0cb49b304 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:21.376972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1219/2456] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:21.382029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:21.394269 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb614-82b8-4a61-949a-cfd100c934ef admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:21.398852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:21.399797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:21.400072 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:21.400377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] PATH_INFO: `/v3/projects/7896518af0694f41875b447b5cd55bce/users/7abd6e85839b4ad68e5a0719267f6854/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:21.415267 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7896518af0694f41875b447b5cd55bce, user_id=7abd6e85839b4ad68e5a0719267f6854, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:21.421301 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:21.567576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1238/2457] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:21 2021] PUT /identity/v3/projects/7896518af0694f41875b447b5cd55bce/users/7abd6e85839b4ad68e5a0719267f6854/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:21.578297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:21.581918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:21.581918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:21.607293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] MFA Rules not processed for user `7abd6e85839b4ad68e5a0719267f6854`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:21.608526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:21.676235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1220/2458] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:21 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:21.680698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:21.748045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984430f9-ec93-42be-a5b6-4fdd0cba883f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:21.752931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:21.753613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:21.753897 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:21.754174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:21.754918 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:21.756899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:21.921603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1239/2459] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:09:21 2021] POST /identity/v3/projects => generated 369 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:21.929857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:21.937962 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3857d-5233-4332-b631-889f138e6811 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:22.000775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:22.001494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.001774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.002032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.002799 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:22.004785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:22.148319 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1221/2460] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:09:21 2021] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:22.152350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:22.163078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b91f-888f-47d4-9ebb-09e5cb6f2304 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:22.168452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:22.169156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.169442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.169721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.170465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:22.172209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:22.185303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1240/2461] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:22.192730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:22.203860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6aea7-5c3a-4aae-8ecb-70fedfda33b8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:22.208655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:22.209584 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.209866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.210140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] PATH_INFO: `/v3/projects/31bad3e69593414ab114a51b6a629e64/users/6de4e37a9d784bd3b88f3343907f444d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.227209 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bad3e69593414ab114a51b6a629e64, user_id=6de4e37a9d784bd3b88f3343907f444d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:22.230187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:22.354242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1222/2462] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:22 2021] PUT /identity/v3/projects/31bad3e69593414ab114a51b6a629e64/users/6de4e37a9d784bd3b88f3343907f444d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:22.358985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:22.369457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc56809-9980-44da-8bc7-575a36932939 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:22.429058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daea01-8000-4609-9045-844e98ac59c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:22.429726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daea01-8000-4609-9045-844e98ac59c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.429922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daea01-8000-4609-9045-844e98ac59c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.430197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daea01-8000-4609-9045-844e98ac59c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.430988 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daea01-8000-4609-9045-844e98ac59c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:22.432625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daea01-8000-4609-9045-844e98ac59c4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:22.444914 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1241/2463] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:22 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:22.449467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:22.460183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c0a2-5094-449a-acd5-8df63e517e1e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:22.465727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:22.466679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.466963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.467240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] PATH_INFO: `/v3/projects/31bad3e69593414ab114a51b6a629e64/users/6de4e37a9d784bd3b88f3343907f444d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.470796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bad3e69593414ab114a51b6a629e64, user_id=6de4e37a9d784bd3b88f3343907f444d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:22.473543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:22.486489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1223/2464] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:22 2021] PUT /identity/v3/projects/31bad3e69593414ab114a51b6a629e64/users/6de4e37a9d784bd3b88f3343907f444d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:22.498453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.498919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.499244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.526077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] MFA Rules not processed for user `6de4e37a9d784bd3b88f3343907f444d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:22.527737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:22.601059 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1242/2465] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:22 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:22.612194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:22.615183 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:22.676679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639447-4c06-4760-a27d-e7c40000c74e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:22.680545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa92f-48ef-436c-90a0-d981f64aaf10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:22.681139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa92f-48ef-436c-90a0-d981f64aaf10 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:22.681478 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa92f-48ef-436c-90a0-d981f64aaf10 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:22.681757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa92f-48ef-436c-90a0-d981f64aaf10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:22.692392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa92f-48ef-436c-90a0-d981f64aaf10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:22.693852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa92f-48ef-436c-90a0-d981f64aaf10 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:22.704082 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1224/2466] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:22 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:09:26.796983 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:26.862420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866fbe7-f290-4ad8-a7cb-04e8bfd0dfbd None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:26.867176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:26.868049 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:26.868331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:26.869282 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] PATH_INFO: `/v3/users/7abd6e85839b4ad68e5a0719267f6854` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:26.871130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd6e85839b4ad68e5a0719267f6854)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:26.873235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:27.207013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd6e85839b4ad68e5a0719267f6854'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:27.207668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd6e85839b4ad68e5a0719267f6854'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:27.307054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd6e85839b4ad68e5a0719267f6854'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:27.307713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd6e85839b4ad68e5a0719267f6854'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:27.322433 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd6e85839b4ad68e5a0719267f6854'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:27.335704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1243/2467] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:09:26 2021] DELETE /identity/v3/users/7abd6e85839b4ad68e5a0719267f6854 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:27.341231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:27.341699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:27.341852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:27.360730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:27.362357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:27.427293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1225/2468] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:27.445565 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:27.447064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:27.505579 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f6a6-17bd-4e9d-aa85-39d68faf74c9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:27.509176 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:27.509834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:27.510118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:27.510398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:27.520414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:27.521864 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:27.532904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1244/2469] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:09:27.994184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:27.994184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:28.006958 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1341cdd-27f7-49cb-9b7f-bfed04053e79 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:28.017166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:28.017166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:28.017166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:28.017166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] PATH_INFO: `/v3/projects/7896518af0694f41875b447b5cd55bce` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:28.017629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7896518af0694f41875b447b5cd55bce)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:28.018778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:28.127731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7896518af0694f41875b447b5cd55bce', 'request_id': 'req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.133831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7896518af0694f41875b447b5cd55bce', 'request_id': 'req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.195093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7896518af0694f41875b447b5cd55bce', 'request_id': 'req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.206175 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] The token cache is being invalidate because project 7896518af0694f41875b447b5cd55bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:09:28.206736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.207378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.209173 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1226/2470] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:09:27 2021] DELETE /identity/v3/projects/7896518af0694f41875b447b5cd55bce => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:28.213346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:28.223595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd409097-fc63-4dbe-81ae-49a00c03d3fd service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:28.279328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:28.280127 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:28.280406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:28.280680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] PATH_INFO: `/v3/users/6de4e37a9d784bd3b88f3343907f444d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:28.281846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de4e37a9d784bd3b88f3343907f444d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:28.283782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:28.528995 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de4e37a9d784bd3b88f3343907f444d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.529726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de4e37a9d784bd3b88f3343907f444d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.604021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de4e37a9d784bd3b88f3343907f444d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.605154 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de4e37a9d784bd3b88f3343907f444d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.617250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-fdb25f33-03e0-45c1-b971-ca6f9fa48967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de4e37a9d784bd3b88f3343907f444d'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:28.630105 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1245/2471] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:09:28 2021] DELETE /identity/v3/users/6de4e37a9d784bd3b88f3343907f444d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:29.079860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:29.081335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:29.095271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe5a6f-c999-4bb6-a9cb-8aa5ecea9079 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:29.152664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:29.153543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:29.154387 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:29.154698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] PATH_INFO: `/v3/projects/31bad3e69593414ab114a51b6a629e64` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:29.155886 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bad3e69593414ab114a51b6a629e64)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:29.157856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:29.326247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bad3e69593414ab114a51b6a629e64', 'request_id': 'req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:29.332548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bad3e69593414ab114a51b6a629e64', 'request_id': 'req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:29.447042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bad3e69593414ab114a51b6a629e64', 'request_id': 'req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:29.458469 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] The token cache is being invalidate because project 31bad3e69593414ab114a51b6a629e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:09:29.458788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:29.459405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-21a4e884-7fd7-4c6a-97a3-ee99c8ccccbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:09:29.461169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1227/2472] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:09:29 2021] DELETE /identity/v3/projects/31bad3e69593414ab114a51b6a629e64 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:09:29.467892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:29.468402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:29.468699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:29.487991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:29.489444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:29.548117 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1246/2473] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:09:29.556242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:29.559359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:29.559359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:29.577378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:29.578845 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:29.588302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1228/2474] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:09:29.592323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:29.602869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b6e91-3be7-45ff-99e5-935021ba7933 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:29.609451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:29.610177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:29.610524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:29.610844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:29.616922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:09:29.616922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:29.616922 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:29.626530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1247/2475] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:09:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:09:29.630982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:29.642676 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95440c46-6ed1-4a7a-9d89-11e325de41c3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:29.648261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:29.648929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:29.649213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:29.649492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:29.650202 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:29.652179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:29.844140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1229/2476] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:09:29 2021] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:09:29.847767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:29.858809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c322d1-8eb4-4670-81bc-29b395bb4eb2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:29.916009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:29.916737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:29.918215 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:29.918507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:29.919270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:29.921210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.131254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1248/2477] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:09:29 2021] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:30.135167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.146029 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288975-3ec4-4235-a253-2d582b0ea950 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.150711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.151420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.151794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.152109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.152831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.154495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.165443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1230/2478] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:30.170320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.180613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968914e-1613-4b13-b534-d9f8a65c6278 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.185927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02343f2-6dcf-4a03-873f-79f7264a5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.186610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02343f2-6dcf-4a03-873f-79f7264a5eda admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.186894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02343f2-6dcf-4a03-873f-79f7264a5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.187167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02343f2-6dcf-4a03-873f-79f7264a5eda admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.187952 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02343f2-6dcf-4a03-873f-79f7264a5eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.189551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02343f2-6dcf-4a03-873f-79f7264a5eda admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.199980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1249/2479] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:30.204058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.214532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d41b-9542-4176-b251-69ce4d50efd9 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.219396 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.220272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.220547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.220844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] PATH_INFO: `/v3/projects/f270e2bebeae4205b792470ea4afdc94/users/40e6a55a3bce47a7993f3a97e3cdf97f/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.235889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f270e2bebeae4205b792470ea4afdc94, user_id=40e6a55a3bce47a7993f3a97e3cdf97f, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.238543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.312895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1231/2480] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:30 2021] PUT /identity/v3/projects/f270e2bebeae4205b792470ea4afdc94/users/40e6a55a3bce47a7993f3a97e3cdf97f/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:30.324779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.327738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.327738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.352491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] MFA Rules not processed for user `40e6a55a3bce47a7993f3a97e3cdf97f`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:30.353740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:30.415633 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1250/2481] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:30 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:30.420811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.484613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66a4e4-9175-4ac7-9fe7-a694a2bf0ab1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.489376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.489965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.490250 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.490527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.491242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.493128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.599461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1232/2482] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:09:30 2021] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:09:30.603454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.614498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944cc6e-2997-4884-82d8-0bc9acc79836 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.672005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.672677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.672962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.673240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.673934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.676144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.821058 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1251/2483] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:09:30 2021] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:09:30.822612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.833686 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67313a-3ac4-4b97-98a7-368a5bdcf80a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.838680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.840026 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.840409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.840690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.841419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.843062 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.853850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1233/2484] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:09:30.858024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.868450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066d5f-947f-4a0f-8cd6-8f21116ef11b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:30.873126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:30.874124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:30.874386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:30.874716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] PATH_INFO: `/v3/projects/a39b9353a9d04ebd993ae53ff3be5e8b/users/2636ac3fa175468abb90dc68bc5c3dfd/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:30.890440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39b9353a9d04ebd993ae53ff3be5e8b, user_id=2636ac3fa175468abb90dc68bc5c3dfd, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:30.893303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:30.957381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1252/2485] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:30 2021] PUT /identity/v3/projects/a39b9353a9d04ebd993ae53ff3be5e8b/users/2636ac3fa175468abb90dc68bc5c3dfd/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:30.961447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:30.971989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4e93e-cf5c-4d9f-9f9a-14ed2134fe13 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:31.028252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965e72a-9907-4b65-b25d-cd24ad14fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:31.028850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965e72a-9907-4b65-b25d-cd24ad14fc9b admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:31.029133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965e72a-9907-4b65-b25d-cd24ad14fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:31.029412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965e72a-9907-4b65-b25d-cd24ad14fc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:31.030135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965e72a-9907-4b65-b25d-cd24ad14fc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:31.031761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965e72a-9907-4b65-b25d-cd24ad14fc9b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:31.041463 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1234/2486] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:09:30 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:09:31.045798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:31.056227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43582a-2c1a-4bfc-bf40-3064ad48d3d5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:31.061559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:31.062428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:31.062745 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:31.063018 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] PATH_INFO: `/v3/projects/a39b9353a9d04ebd993ae53ff3be5e8b/users/2636ac3fa175468abb90dc68bc5c3dfd/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:31.064930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39b9353a9d04ebd993ae53ff3be5e8b, user_id=2636ac3fa175468abb90dc68bc5c3dfd, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:31.067585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:31.078038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1253/2487] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:09:31 2021] PUT /identity/v3/projects/a39b9353a9d04ebd993ae53ff3be5e8b/users/2636ac3fa175468abb90dc68bc5c3dfd/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:09:31.088256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:31.088554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:31.088937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:31.115321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] MFA Rules not processed for user `2636ac3fa175468abb90dc68bc5c3dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:09:31.116525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:31.183361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1235/2488] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:09:31 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:09:31.193394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:31.195123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:09:31.254773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d4f0-8a89-4a0f-9922-57fd3b5619f8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:31.258551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade1318-b7d1-4fd6-bbc1-0106b385f77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:31.259235 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade1318-b7d1-4fd6-bbc1-0106b385f77a service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:31.259519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade1318-b7d1-4fd6-bbc1-0106b385f77a service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:31.259793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade1318-b7d1-4fd6-bbc1-0106b385f77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:31.321568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade1318-b7d1-4fd6-bbc1-0106b385f77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:31.322972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade1318-b7d1-4fd6-bbc1-0106b385f77a service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:31.333124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1254/2489] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:09:39.706545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:09:39.716345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c62cf-adce-4897-9c82-3f1ea34c9535 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:09:39.720288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:09:39.721628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:09:39.721628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:09:39.721628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:09:39.732189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:09:39.733578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:09:39.743572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1236/2490] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:09:39 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:01.089503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc138-2121-42d4-a1fa-69a9fb111e9f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:01.090028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc138-2121-42d4-a1fa-69a9fb111e9f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:01.090249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc138-2121-42d4-a1fa-69a9fb111e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:01.110605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c50cc138-2121-42d4-a1fa-69a9fb111e9f None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:01.111805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c50cc138-2121-42d4-a1fa-69a9fb111e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:01.167969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1255/2491] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:10:01 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:01.182139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:01.183593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:01.257675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8f6e-4ff1-403c-bfa2-bd9951569904 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:01.262658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea9ed-ac2c-4e6a-bbbc-0ced5796d067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:01.263316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea9ed-ac2c-4e6a-bbbc-0ced5796d067 service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:01.263717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea9ed-ac2c-4e6a-bbbc-0ced5796d067 service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:01.264007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea9ed-ac2c-4e6a-bbbc-0ced5796d067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:01.273388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fea9ed-ac2c-4e6a-bbbc-0ced5796d067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:01.275162 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fea9ed-ac2c-4e6a-bbbc-0ced5796d067 service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:01.284429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1237/2492] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:10:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:10:18.048135 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cf67-98a1-4e39-8f91-cf268994f3a9 None None] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:18.048740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cf67-98a1-4e39-8f91-cf268994f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:18.049289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cf67-98a1-4e39-8f91-cf268994f3a9 None None] PATH_INFO: `/` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:18.052008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1256/2493] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:10:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:10:18.058480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0da3e0-7bae-4314-95d8-13993d3af6bd None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:18.059039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0da3e0-7bae-4314-95d8-13993d3af6bd None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:18.059647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0da3e0-7bae-4314-95d8-13993d3af6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:18.089135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-bc0da3e0-7bae-4314-95d8-13993d3af6bd None None] MFA Rules not processed for user `40245bfc762a492587d3e4d39abea6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:18.090388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-bc0da3e0-7bae-4314-95d8-13993d3af6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:18.150763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1238/2494] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:10:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:18.163811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04cf67-98a1-4e39-8f91-cf268994f3a9 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:18.165589 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-df04cf67-98a1-4e39-8f91-cf268994f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:18.180132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04cf67-98a1-4e39-8f91-cf268994f3a9 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:18.183882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:18.184530 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:18.184814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:18.185095 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:18.195870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:18.197391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:18.206050 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1257/2495] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:18 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:10:19.468973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:19.469433 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:19.469529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:19.487280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:19.488413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:19.495550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1239/2496] 10.222.0.73 () {58 vars in 968 bytes} [Fri Aug 27 04:10:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:19.508639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:19.521174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5cce1-31d5-404f-9f55-da36c5b3b1c5 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:19.526161 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ddff-f3c8-49f9-8ac1-30b9a12838df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:19.526823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ddff-f3c8-49f9-8ac1-30b9a12838df service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:19.527102 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ddff-f3c8-49f9-8ac1-30b9a12838df service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:19.527374 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ddff-f3c8-49f9-8ac1-30b9a12838df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:19.535826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ddff-f3c8-49f9-8ac1-30b9a12838df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:19.538957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ddff-f3c8-49f9-8ac1-30b9a12838df service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:19.545743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1258/2497] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:10:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:10:21.164796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:21.236476 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85a5c-ac9a-4b17-ac7b-c818640516a3 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:21.242638 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:21.243820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:21.244712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:21.244712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] PATH_INFO: `/v3/users/40e6a55a3bce47a7993f3a97e3cdf97f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:21.246041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e6a55a3bce47a7993f3a97e3cdf97f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:21.248105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:21.492852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e6a55a3bce47a7993f3a97e3cdf97f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:21.570259 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e6a55a3bce47a7993f3a97e3cdf97f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:21.583553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e6a55a3bce47a7993f3a97e3cdf97f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:21.584263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e6a55a3bce47a7993f3a97e3cdf97f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:21.584874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e6a55a3bce47a7993f3a97e3cdf97f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:21.598474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1240/2498] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:21 2021] DELETE /identity/v3/users/40e6a55a3bce47a7993f3a97e3cdf97f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:21.603039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:21.603524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:21.603768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:21.623087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:21.624931 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:21.693217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1259/2499] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:21.703307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:21.705160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:21.768054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caa01b-b225-4541-925a-d953bc4c1dd1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:21.771677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:21.772340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:21.772619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:21.772901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:21.783767 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:21.786054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:21.797595 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1241/2500] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:22.319708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:22.321636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:22.334900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937cc97-6d1c-4b01-bde0-2e1d01ad1064 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:22.349622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:22.349622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:22.349622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:22.349622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] PATH_INFO: `/v3/projects/f270e2bebeae4205b792470ea4afdc94` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:22.350073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f270e2bebeae4205b792470ea4afdc94)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:22.350073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:22.459014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f270e2bebeae4205b792470ea4afdc94', 'request_id': 'req-6dd2d09f-c8ad-45a4-8560-0c99724018ad'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:22.555078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f270e2bebeae4205b792470ea4afdc94', 'request_id': 'req-6dd2d09f-c8ad-45a4-8560-0c99724018ad'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:22.561188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f270e2bebeae4205b792470ea4afdc94', 'request_id': 'req-6dd2d09f-c8ad-45a4-8560-0c99724018ad'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:22.576719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] The token cache is being invalidate because project f270e2bebeae4205b792470ea4afdc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:22.577020 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:22.578297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:22.580667 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1260/2501] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:22 2021] DELETE /identity/v3/projects/f270e2bebeae4205b792470ea4afdc94 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:22.584744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:22.595769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078bcb-5c88-4c26-a9ab-c61f188240d2 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:22.665074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:22.665982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:22.666264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:22.666542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] PATH_INFO: `/v3/users/2636ac3fa175468abb90dc68bc5c3dfd` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:22.667788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2636ac3fa175468abb90dc68bc5c3dfd)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:22.669772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:22.728692 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:22.730250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:22.748571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2d09f-c8ad-45a4-8560-0c99724018ad admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:22.754146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:22.755063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:22.755366 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:22.755624 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] PATH_INFO: `/v3/users/bc5d70235d054703a69d76fd54daf683` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:22.756881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5d70235d054703a69d76fd54daf683)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:22.758982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:22.888128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2636ac3fa175468abb90dc68bc5c3dfd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.089022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5d70235d054703a69d76fd54daf683'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.089681 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5d70235d054703a69d76fd54daf683'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.109803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2636ac3fa175468abb90dc68bc5c3dfd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.122260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2636ac3fa175468abb90dc68bc5c3dfd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.122957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2636ac3fa175468abb90dc68bc5c3dfd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.123574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2636ac3fa175468abb90dc68bc5c3dfd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.136613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1242/2502] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:22 2021] DELETE /identity/v3/users/2636ac3fa175468abb90dc68bc5c3dfd => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:23.189616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5d70235d054703a69d76fd54daf683'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.190451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5d70235d054703a69d76fd54daf683'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.204964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5d70235d054703a69d76fd54daf683'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.219103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1261/2503] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:22 2021] DELETE /identity/v3/users/bc5d70235d054703a69d76fd54daf683 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:23.496157 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:23.497607 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:23.563149 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9f1a7-c284-4b7e-96b6-a0df4536c5f3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:23.607930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:23.610635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:23.630780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:23.632195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:23.632684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:23.632966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] PATH_INFO: `/v3/projects/a65ba74164e2464cab37a8459816ebab` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:23.634199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65ba74164e2464cab37a8459816ebab)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:23.636151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:23.681851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d7a4-6524-4021-ab72-e914f8e98099 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:23.687187 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:23.687980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:23.688265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:23.688543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] PATH_INFO: `/v3/projects/a39b9353a9d04ebd993ae53ff3be5e8b` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:23.689726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39b9353a9d04ebd993ae53ff3be5e8b)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:23.691695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:23.767403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65ba74164e2464cab37a8459816ebab', 'request_id': 'req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.773882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65ba74164e2464cab37a8459816ebab', 'request_id': 'req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.841350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39b9353a9d04ebd993ae53ff3be5e8b', 'request_id': 'req-ab24828d-147a-433c-800f-d7c9b344c4e9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.857926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65ba74164e2464cab37a8459816ebab', 'request_id': 'req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.871438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] The token cache is being invalidate because project a65ba74164e2464cab37a8459816ebab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:23.871921 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.872759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e6dc2651-2af7-4dee-8f3e-eacd07c4747d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.874794 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1243/2504] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:23 2021] DELETE /identity/v3/projects/a65ba74164e2464cab37a8459816ebab => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:23.883084 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346e493-a070-479c-85a9-5d43ec0c450f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:23.883518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346e493-a070-479c-85a9-5d43ec0c450f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:23.884024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346e493-a070-479c-85a9-5d43ec0c450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:23.903701 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d346e493-a070-479c-85a9-5d43ec0c450f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:23.904893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d346e493-a070-479c-85a9-5d43ec0c450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:23.946503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39b9353a9d04ebd993ae53ff3be5e8b', 'request_id': 'req-ab24828d-147a-433c-800f-d7c9b344c4e9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.953236 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39b9353a9d04ebd993ae53ff3be5e8b', 'request_id': 'req-ab24828d-147a-433c-800f-d7c9b344c4e9'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.964393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] The token cache is being invalidate because project a39b9353a9d04ebd993ae53ff3be5e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:23.964688 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.965555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ab24828d-147a-433c-800f-d7c9b344c4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:23.967133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1262/2505] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:23 2021] DELETE /identity/v3/projects/a39b9353a9d04ebd993ae53ff3be5e8b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:23.968274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1244/2506] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:23.974122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652380f-74b6-4ba6-be7a-fbccc89b3d4c None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:23.974708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652380f-74b6-4ba6-be7a-fbccc89b3d4c None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:23.975000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652380f-74b6-4ba6-be7a-fbccc89b3d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:23.975816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:23.976144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:23.976442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:23.994952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:23.995234 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6652380f-74b6-4ba6-be7a-fbccc89b3d4c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:23.996161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:23.996790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6652380f-74b6-4ba6-be7a-fbccc89b3d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:24.004416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1245/2507] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:24.005091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1263/2508] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:24.008474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.014005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.014302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.014611 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.017807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bfe65-31d6-4850-83e7-a76c2705ec38 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.023864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.023864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.023864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.023864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.024532 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:10:24.024844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.026454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.033461 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:24.034712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:24.040549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1246/2509] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:10:24.045820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1264/2510] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:24.046470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.048086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.055580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d771f-22ef-4006-b5a2-83d394f06aaa admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.057150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc647-5d5d-4ee7-ba5c-3c1ab5845c7f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.060284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.060937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.061224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.061542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.061781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.062240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.062423 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.062739 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.063015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.063740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:10:24.064045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.064167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.065625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.077559 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1265/2511] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:10:24.082367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.092082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f90e68-0687-4645-8523-975b3ab0b595 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.097484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.101723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.101723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.101723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.101723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.101723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.191350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1247/2512] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:24.195244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.209990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1266/2513] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:24.212768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.260243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8923f-8c0a-4911-8eb1-da269cc02e76 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.273406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbeac7-0637-459e-ac15-ee1f720e23b7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.278195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.278942 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.279231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.279510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.280928 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.283367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.315819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.316489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.316769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.317045 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.317777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.319727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.413538 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1267/2514] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:24.417620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.427823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8840d7f-e1f3-4394-955f-06c8c442e370 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.432513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.433179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.433453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.433728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.434443 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.436077 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.446035 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1268/2515] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:10:24.450146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.454176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1248/2516] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:24.459214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.462205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f233837-000e-4af2-8355-bde48444041b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.467016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.468648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.468993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.469355 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.470852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500e544-5414-4506-91c9-fd065156d1c3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.471628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.471869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.477570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.477763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.478427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.478549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.479412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.481056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.482464 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1269/2517] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:10:24.486532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.495418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1249/2518] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:10:24.496333 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.496632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdb4cd-1e41-401f-b840-7514d62bece4 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.502089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a464f-c454-4064-82e4-c597baad7f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.503007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a464f-c454-4064-82e4-c597baad7f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.503295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a464f-c454-4064-82e4-c597baad7f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.503576 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a464f-c454-4064-82e4-c597baad7f59 admin admin] PATH_INFO: `/v3/projects/378b66e205104dc08acd2fb902f3ca99/users/11765ac3ef764a05bb114d90dfb53bd3/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.507420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a30df-eaf9-46d0-ba10-452093877bee admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.512493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.513146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.513486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.513848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.515955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.517571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.518818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a464f-c454-4064-82e4-c597baad7f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378b66e205104dc08acd2fb902f3ca99, user_id=11765ac3ef764a05bb114d90dfb53bd3, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.521458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a464f-c454-4064-82e4-c597baad7f59 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.528254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1250/2519] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:10:24.532690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.542353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f869b8-48a6-4bee-bf9a-96d57e29266a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.547265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e77e9-29e9-454e-8c55-8217b8448485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.548137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e77e9-29e9-454e-8c55-8217b8448485 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.548418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e77e9-29e9-454e-8c55-8217b8448485 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.548707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e77e9-29e9-454e-8c55-8217b8448485 admin admin] PATH_INFO: `/v3/projects/3bdddfb4859a4e3ebd630dd12db76045/users/ff3bef628cc748d58ee6fd4d8fd683e2/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.564922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e77e9-29e9-454e-8c55-8217b8448485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bdddfb4859a4e3ebd630dd12db76045, user_id=ff3bef628cc748d58ee6fd4d8fd683e2, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.567663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e77e9-29e9-454e-8c55-8217b8448485 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.588775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1270/2520] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:24 2021] PUT /identity/v3/projects/378b66e205104dc08acd2fb902f3ca99/users/11765ac3ef764a05bb114d90dfb53bd3/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:24.598673 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.598968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.599242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.625871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] MFA Rules not processed for user `11765ac3ef764a05bb114d90dfb53bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:24.627149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:24.642040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1251/2521] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:24 2021] PUT /identity/v3/projects/3bdddfb4859a4e3ebd630dd12db76045/users/ff3bef628cc748d58ee6fd4d8fd683e2/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:24.651758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.652056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.652332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.679052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] MFA Rules not processed for user `ff3bef628cc748d58ee6fd4d8fd683e2`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:24.680286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:24.690921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1271/2522] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:24.695027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.742866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1252/2523] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:24.755117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.756385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d763d-42e6-4682-b715-8b5d30ddd39d None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.756509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:24.810874 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.812518 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.812662 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffa25-0d44-47a7-9eef-9fa8c0fbdf81 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.812776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.812776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.813455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.815419 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.816354 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.817003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.817286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.817561 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.826080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.828172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:24.837195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1253/2524] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:24 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:24.909048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1272/2525] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:24.913110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:24.926887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a4e5-ecae-4a17-8321-e54e6cb1987c service glance] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:24.992503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:24.994872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:24.995142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:24.996305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:24.997210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:24.999874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:25.127756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1254/2526] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:24 2021] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:25.134592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:25.144896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a03f-1571-4923-9336-06dadfb105b9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:25.149407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:25.150086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.150364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.150718 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.151489 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:25.153130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:25.163573 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1273/2527] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:25.167897 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:25.178700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98e16c-37bc-43f9-984c-02973c3bde76 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:25.183372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:25.184246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.184526 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.184798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] PATH_INFO: `/v3/projects/88b5457c0aae4c759ae119190a5d8523/users/a396461c73084bd7b487c956c1a11263/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.199963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b5457c0aae4c759ae119190a5d8523, user_id=a396461c73084bd7b487c956c1a11263, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:25.202925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:25.335909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1255/2528] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:25 2021] PUT /identity/v3/projects/88b5457c0aae4c759ae119190a5d8523/users/a396461c73084bd7b487c956c1a11263/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:25.339795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:25.350244 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6b93e-a2cf-4be0-b8bd-b0d2dea5fc29 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:25.403531 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b423-321e-4453-9142-b80a4c60fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:25.404204 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b423-321e-4453-9142-b80a4c60fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.404491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b423-321e-4453-9142-b80a4c60fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.404767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b423-321e-4453-9142-b80a4c60fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.406037 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780b423-321e-4453-9142-b80a4c60fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:25.407715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780b423-321e-4453-9142-b80a4c60fcf3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:25.417459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1274/2529] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:25 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:25.422211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:25.432861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9891-d0c0-4188-b97d-251c1afb577e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:25.437657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:25.438531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.438853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.439130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] PATH_INFO: `/v3/projects/88b5457c0aae4c759ae119190a5d8523/users/a396461c73084bd7b487c956c1a11263/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.441131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b5457c0aae4c759ae119190a5d8523, user_id=a396461c73084bd7b487c956c1a11263, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:25.443814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:25.454196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1256/2530] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:25 2021] PUT /identity/v3/projects/88b5457c0aae4c759ae119190a5d8523/users/a396461c73084bd7b487c956c1a11263/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:25.464298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.464662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.465012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.492210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] MFA Rules not processed for user `a396461c73084bd7b487c956c1a11263`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:25.493429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:25.559784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1275/2531] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:25 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:25.570495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:25.572224 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:25.627497 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2c0d-eec8-47bd-ae60-b8c50826ffbe admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:25.631663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fafd06-076f-4b85-a9f3-1651a6e12aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:25.632307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fafd06-076f-4b85-a9f3-1651a6e12aee service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.632621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fafd06-076f-4b85-a9f3-1651a6e12aee service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.632893 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fafd06-076f-4b85-a9f3-1651a6e12aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.642518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fafd06-076f-4b85-a9f3-1651a6e12aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:25.643969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fafd06-076f-4b85-a9f3-1651a6e12aee service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:25.653350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1257/2532] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:25 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:10:25.715376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:25.781660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743bdd8-df58-466f-b276-e01ac5a13455 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:25.786477 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:25.787447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:25.787710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:25.787965 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] PATH_INFO: `/v3/users/11765ac3ef764a05bb114d90dfb53bd3` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:25.789183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11765ac3ef764a05bb114d90dfb53bd3)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:25.791149 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:26.009400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11765ac3ef764a05bb114d90dfb53bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:26.010082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11765ac3ef764a05bb114d90dfb53bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:26.117525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11765ac3ef764a05bb114d90dfb53bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:26.118242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11765ac3ef764a05bb114d90dfb53bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:26.132857 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11765ac3ef764a05bb114d90dfb53bd3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:26.146279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1276/2533] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:25 2021] DELETE /identity/v3/users/11765ac3ef764a05bb114d90dfb53bd3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:26.153208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:26.153489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:26.153795 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:26.172567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:26.177784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:26.235670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1258/2534] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:26.251061 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:26.252471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:26.309936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0b129-fccd-451f-9656-fd11c71f4c82 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:26.315299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:26.315958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:26.316240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:26.316548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:26.326201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:26.329054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:26.339182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1277/2535] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:26.783294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:26.783294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:26.795368 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c14dc-25c5-4c60-b8da-0f23ef63acde None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:26.801738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:26.802640 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:26.803020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:26.803853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] PATH_INFO: `/v3/projects/378b66e205104dc08acd2fb902f3ca99` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:26.804518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=378b66e205104dc08acd2fb902f3ca99)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:26.806299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:26.959194 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378b66e205104dc08acd2fb902f3ca99', 'request_id': 'req-979d5554-2739-4501-9ff3-f94bc41e09ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:26.965961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378b66e205104dc08acd2fb902f3ca99', 'request_id': 'req-979d5554-2739-4501-9ff3-f94bc41e09ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.055167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378b66e205104dc08acd2fb902f3ca99', 'request_id': 'req-979d5554-2739-4501-9ff3-f94bc41e09ba'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.066550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] The token cache is being invalidate because project 378b66e205104dc08acd2fb902f3ca99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:27.067131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.067790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.069738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1259/2536] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:26 2021] DELETE /identity/v3/projects/378b66e205104dc08acd2fb902f3ca99 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:27.073598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:27.083635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46034d85-5f53-42d5-8f18-7419cd217bad service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:27.142143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:27.143064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:27.143351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:27.143627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] PATH_INFO: `/v3/users/a396461c73084bd7b487c956c1a11263` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:27.145250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a396461c73084bd7b487c956c1a11263)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:27.147144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:27.335959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a396461c73084bd7b487c956c1a11263'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.340370 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a396461c73084bd7b487c956c1a11263'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.414921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a396461c73084bd7b487c956c1a11263'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.415860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a396461c73084bd7b487c956c1a11263'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.436396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9f146852-d06d-4dc0-a8e8-d6187d327369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a396461c73084bd7b487c956c1a11263'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:27.450590 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1278/2537] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:27 2021] DELETE /identity/v3/users/a396461c73084bd7b487c956c1a11263 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:27.996052 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:27.998606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:28.015877 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5554-2739-4501-9ff3-f94bc41e09ba admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.074447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.075253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.075534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.075804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] PATH_INFO: `/v3/projects/88b5457c0aae4c759ae119190a5d8523` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.077585 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b5457c0aae4c759ae119190a5d8523)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.081426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:28.214457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b5457c0aae4c759ae119190a5d8523', 'request_id': 'req-243e4699-2deb-43b3-8640-40f52a51266f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:28.221537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b5457c0aae4c759ae119190a5d8523', 'request_id': 'req-243e4699-2deb-43b3-8640-40f52a51266f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:28.312813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b5457c0aae4c759ae119190a5d8523', 'request_id': 'req-243e4699-2deb-43b3-8640-40f52a51266f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:28.323854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] The token cache is being invalidate because project 88b5457c0aae4c759ae119190a5d8523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:28.324144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:28.324865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-243e4699-2deb-43b3-8640-40f52a51266f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:28.326353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1260/2538] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:27 2021] DELETE /identity/v3/projects/88b5457c0aae4c759ae119190a5d8523 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:28.332774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.333484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.333484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.351761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:28.352958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:28.412812 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1279/2539] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:28.421976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.422379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.422769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.443972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:28.445246 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:28.453626 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1261/2540] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:28.457904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:28.467484 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825b94-48dd-46aa-8d3c-9797f1899d56 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.472273 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.472930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.473212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.473487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.474212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:10:28.474519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.476172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:28.487847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1280/2541] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:10:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:10:28.492416 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:28.502400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9596-56cf-4999-8d65-63bf43095561 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.507014 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.507667 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.507945 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.508215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.508901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.510909 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:28.632374 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1262/2542] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:28 2021] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:28.636609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:28.647721 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf603ae-9a3c-4649-b571-b86249082973 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.706490 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.707441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.707806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.708155 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.708865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.710945 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:28.814685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1281/2543] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:28 2021] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:28.819422 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:28.830206 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154c10-59cd-4e12-8f2a-3672fb29ecb6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.836457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.837129 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.837415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.837690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.838606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.840241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:28.851955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1263/2544] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:28.856075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:28.866950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7fcb-76ad-4205-b12b-1438484cf8e0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.871793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b308-0b68-4bad-91ae-a0da787e41fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.872455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b308-0b68-4bad-91ae-a0da787e41fd admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.872738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b308-0b68-4bad-91ae-a0da787e41fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.873016 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b308-0b68-4bad-91ae-a0da787e41fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.874388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1b308-0b68-4bad-91ae-a0da787e41fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.877197 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1b308-0b68-4bad-91ae-a0da787e41fd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:28.908166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1282/2545] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:28.911643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:28.922515 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2575c-01a5-4992-95b4-96ba8728c851 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:28.927673 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:28.928564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:28.928841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:28.929114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] PATH_INFO: `/v3/projects/987b5c44123842c6b38120108095745a/users/d31d7d6b82e740a7b2af78f9520f6483/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:28.946696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=987b5c44123842c6b38120108095745a, user_id=d31d7d6b82e740a7b2af78f9520f6483, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:28.949685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.101540 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1264/2546] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:28 2021] PUT /identity/v3/projects/987b5c44123842c6b38120108095745a/users/d31d7d6b82e740a7b2af78f9520f6483/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:29.116771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.117101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.117405 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.147638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] MFA Rules not processed for user `d31d7d6b82e740a7b2af78f9520f6483`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:29.148919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:29.213776 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1283/2547] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:29 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:29.220411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:29.285160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53457fd-bf5b-431b-be40-adbfa11aa5ce admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:29.290110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:29.290797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.291079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.291350 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.292033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:29.293914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.402301 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1265/2548] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:29 2021] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:29.407344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:29.418060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6b186-bae8-4bbb-a7ea-95d6fbf46095 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:29.475118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:29.475719 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.476005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.476280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.476972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:29.479003 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.590451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1284/2549] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:29 2021] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:29.594051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:29.604306 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551bbb6-b2c9-42b6-a728-659cf608195a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:29.610075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:29.610798 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.611078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.611356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.612091 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:29.613699 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.625390 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1266/2550] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:29.629651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:29.639583 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960bf47-f195-4087-b368-7e28334e4870 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:29.644344 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:29.645223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.645501 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.645773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] PATH_INFO: `/v3/projects/e9baf09a568142a5b2515e584349729b/users/6866161e43024d698d64ddfc7bbbddb5/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.661031 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9baf09a568142a5b2515e584349729b, user_id=6866161e43024d698d64ddfc7bbbddb5, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:29.663813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.755268 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1285/2551] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:29 2021] PUT /identity/v3/projects/e9baf09a568142a5b2515e584349729b/users/6866161e43024d698d64ddfc7bbbddb5/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:29.759126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:29.769243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b614b98-0954-4b8c-93b2-c0beb9463f4a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:29.831286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75bddd-5859-4188-8b12-5a7a2c837291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:29.831969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75bddd-5859-4188-8b12-5a7a2c837291 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.832253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75bddd-5859-4188-8b12-5a7a2c837291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.832551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75bddd-5859-4188-8b12-5a7a2c837291 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.833280 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75bddd-5859-4188-8b12-5a7a2c837291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:29.834923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75bddd-5859-4188-8b12-5a7a2c837291 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.845569 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1267/2552] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:29 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:29.849705 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:29.861230 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253358c-e71b-4dd8-abe3-56bbb259814e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:29.866283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:29.867295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.867656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.868002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] PATH_INFO: `/v3/projects/e9baf09a568142a5b2515e584349729b/users/6866161e43024d698d64ddfc7bbbddb5/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.870185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9baf09a568142a5b2515e584349729b, user_id=6866161e43024d698d64ddfc7bbbddb5, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:29.872919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:29.884046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1286/2553] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:29 2021] PUT /identity/v3/projects/e9baf09a568142a5b2515e584349729b/users/6866161e43024d698d64ddfc7bbbddb5/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:29.894632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:29.894925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:29.895205 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:29.922712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] MFA Rules not processed for user `6866161e43024d698d64ddfc7bbbddb5`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:29.923942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:29.996264 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1268/2554] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:29 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:30.006029 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:30.007723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:30.065851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e97b8-86f8-4399-8e6d-debca7d3c59e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:30.069486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:30.070138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:30.070422 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:30.070740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:30.081136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:30.082792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:30.093151 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1287/2555] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:30 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:30.188754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:30.198750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf698e-02a9-4999-84ec-6f06f5edb0e8 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:30.202778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f7cb4-fa96-4377-baf7-c9914f724ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:30.204589 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f7cb4-fa96-4377-baf7-c9914f724ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:30.204873 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f7cb4-fa96-4377-baf7-c9914f724ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:30.205151 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f7cb4-fa96-4377-baf7-c9914f724ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:30.261802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f7cb4-fa96-4377-baf7-c9914f724ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:30.263550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f7cb4-fa96-4377-baf7-c9914f724ae4 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:30.274068 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1269/2556] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:30 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:34.488328 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:34.553905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6720-cd22-44fb-802f-8dac4d5f8eb6 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:34.558774 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:34.559649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:34.559929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:34.560650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] PATH_INFO: `/v3/users/d31d7d6b82e740a7b2af78f9520f6483` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:34.561399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31d7d6b82e740a7b2af78f9520f6483)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:34.563438 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:34.756892 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31d7d6b82e740a7b2af78f9520f6483'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:34.757462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31d7d6b82e740a7b2af78f9520f6483'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:34.835283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31d7d6b82e740a7b2af78f9520f6483'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:34.836173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31d7d6b82e740a7b2af78f9520f6483'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:34.849778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31d7d6b82e740a7b2af78f9520f6483'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:34.862195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1288/2557] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:34 2021] DELETE /identity/v3/users/d31d7d6b82e740a7b2af78f9520f6483 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:34.866888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:34.867389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:34.867493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:34.887197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:34.888407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:34.948816 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1270/2558] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:34.960136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:34.961620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:35.028039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960353-5d40-48fb-b7b6-9eb0d3b437fa admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:35.031693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:35.032372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:35.032872 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:35.033025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:35.043527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:35.044967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:35.056098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1289/2559] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:35.525353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:35.526908 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:35.539578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caac1a-8f4a-435e-8360-3935db6c09bf None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:35.547522 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:35.548405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:35.548713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:35.548992 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] PATH_INFO: `/v3/projects/987b5c44123842c6b38120108095745a` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:35.550440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] RBAC: Authorizing `identity:delete_project(project_id=987b5c44123842c6b38120108095745a)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:35.552773 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:35.679016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987b5c44123842c6b38120108095745a', 'request_id': 'req-cbfd70a6-3ade-488b-b86c-25ec9e77deef'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:35.685722 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987b5c44123842c6b38120108095745a', 'request_id': 'req-cbfd70a6-3ade-488b-b86c-25ec9e77deef'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:35.772377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987b5c44123842c6b38120108095745a', 'request_id': 'req-cbfd70a6-3ade-488b-b86c-25ec9e77deef'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:35.783948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] The token cache is being invalidate because project 987b5c44123842c6b38120108095745a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:35.784240 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:35.787034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:35.787034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1271/2560] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:35 2021] DELETE /identity/v3/projects/987b5c44123842c6b38120108095745a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:35.790441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:35.800098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969f5ce-cd94-4006-a530-857c14a95d03 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:35.856969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:35.857848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:35.858131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:35.858406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] PATH_INFO: `/v3/users/6866161e43024d698d64ddfc7bbbddb5` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:35.859623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6866161e43024d698d64ddfc7bbbddb5)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:35.861558 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:36.100363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6866161e43024d698d64ddfc7bbbddb5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:36.101076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6866161e43024d698d64ddfc7bbbddb5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:36.189255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6866161e43024d698d64ddfc7bbbddb5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:36.190612 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6866161e43024d698d64ddfc7bbbddb5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:36.204562 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-2899b734-b3cf-432d-9244-4b6bc14a4a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6866161e43024d698d64ddfc7bbbddb5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:36.217708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1290/2561] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:35 2021] DELETE /identity/v3/users/6866161e43024d698d64ddfc7bbbddb5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:36.699846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:36.701405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:36.714216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd70a6-3ade-488b-b86c-25ec9e77deef admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:36.772780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:36.773669 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:36.773952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:36.774227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] PATH_INFO: `/v3/projects/e9baf09a568142a5b2515e584349729b` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:36.775670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9baf09a568142a5b2515e584349729b)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:36.778030 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:36.896154 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9baf09a568142a5b2515e584349729b', 'request_id': 'req-f2062bbb-9695-482d-8bd6-f360b0e947e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:36.902899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9baf09a568142a5b2515e584349729b', 'request_id': 'req-f2062bbb-9695-482d-8bd6-f360b0e947e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:37.015023 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9baf09a568142a5b2515e584349729b', 'request_id': 'req-f2062bbb-9695-482d-8bd6-f360b0e947e9'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:37.027375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] The token cache is being invalidate because project e9baf09a568142a5b2515e584349729b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:37.027682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:37.028315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f2062bbb-9695-482d-8bd6-f360b0e947e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:37.029911 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1272/2562] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:36 2021] DELETE /identity/v3/projects/e9baf09a568142a5b2515e584349729b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:37.036606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.037142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.037142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.055460 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:37.060591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:37.115546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1291/2563] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:37.124464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.124752 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.125033 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.144307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:37.145406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:37.153425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1273/2564] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:37.157729 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.168196 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b230fb-967b-4b02-bf4d-b0255062c4e3 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.173742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.175403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.175703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.176089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.177158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:10:37.177467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.179134 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:37.191351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1292/2565] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:10:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:10:37.195695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.204780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37fe76-3c7f-49b2-b5b5-43bd8894dcef None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.209677 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.210327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.210641 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.210919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.211613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.213498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:37.306019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1274/2566] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:37 2021] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:37.310055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.319949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1322d93-7481-4934-b2b4-644bf1de4b76 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.380373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.381097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.381676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.381967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.382712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.384682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:37.469827 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1293/2567] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:37 2021] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:37.474487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.485075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345a17-3d8e-42fd-a3e2-f9961e1e4b53 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.490619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.491297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.491578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.491853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.492602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.494249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:37.505221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1275/2568] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:37.509228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.519229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535a13-19c0-4d70-ba50-25a73c82ba8b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.523999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b288579-60c1-4873-985a-f1d34427c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.524726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b288579-60c1-4873-985a-f1d34427c6de admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.525008 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b288579-60c1-4873-985a-f1d34427c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.525287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b288579-60c1-4873-985a-f1d34427c6de admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.526005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b288579-60c1-4873-985a-f1d34427c6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.527683 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b288579-60c1-4873-985a-f1d34427c6de admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:37.538540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1294/2569] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:37.542744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.554572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b5cd0-a5b8-4a8b-bcc4-38888680e8f8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.559479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.560366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.560684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.560961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] PATH_INFO: `/v3/projects/163ad99cb55c4a0bb36bee90c7a824fc/users/2f0913d086694d37be7377384aef8af6/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.575622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] RBAC: Authorizing `identity:create_grant(project_id=163ad99cb55c4a0bb36bee90c7a824fc, user_id=2f0913d086694d37be7377384aef8af6, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.578268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:37.684826 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1276/2570] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:37 2021] PUT /identity/v3/projects/163ad99cb55c4a0bb36bee90c7a824fc/users/2f0913d086694d37be7377384aef8af6/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:37.695225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.695515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.695793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.724894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] MFA Rules not processed for user `2f0913d086694d37be7377384aef8af6`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:37.726133 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:37.790295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1295/2571] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:37 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:37.794870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:37.856547 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4968b-b2ba-49b8-bc40-1af3f95f510f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:37.861370 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:37.862124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:37.862405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:37.862706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:37.863429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:37.865340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.001539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1277/2572] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:37 2021] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:38.006238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.016697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18df82-074d-4f5b-82b6-c21560f037d7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.075958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.076649 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.076909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.077186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.077881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.079825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.190610 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1296/2573] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:38 2021] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:38.194786 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.205188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806cc48-f28c-4a9d-875a-a8eafc446bd2 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.210608 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.211268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.211551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.211827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.212551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.214136 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.225247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1278/2574] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:38.229361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.239440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a7d40-ca0f-404f-b482-587619024506 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.243984 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb916-5eb4-467c-bf54-0f083a4ff86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.244648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb916-5eb4-467c-bf54-0f083a4ff86b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.244932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb916-5eb4-467c-bf54-0f083a4ff86b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.245211 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb916-5eb4-467c-bf54-0f083a4ff86b admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.245934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeb916-5eb4-467c-bf54-0f083a4ff86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.247563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeb916-5eb4-467c-bf54-0f083a4ff86b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.257978 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1297/2575] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:38.262268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.273103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d055c4c-6606-4cd3-a2bb-d2f555a49b5d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.277839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.278862 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.279152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.279432 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] PATH_INFO: `/v3/projects/d1f467cb1fca41569b323766e5a31fd0/users/fe7e53f855874e4ea3fc855ebc3703b4/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.294922 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f467cb1fca41569b323766e5a31fd0, user_id=fe7e53f855874e4ea3fc855ebc3703b4, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.297573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.369425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1279/2576] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:38 2021] PUT /identity/v3/projects/d1f467cb1fca41569b323766e5a31fd0/users/fe7e53f855874e4ea3fc855ebc3703b4/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:38.381656 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.381974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.382255 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.410459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] MFA Rules not processed for user `fe7e53f855874e4ea3fc855ebc3703b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:38.411722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:38.479492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1298/2577] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:38 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:38.484635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.545974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bf4d2-6f27-4120-bbcd-03c3e24c60c1 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.551294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.552197 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.552480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.552753 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.553456 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.555358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.665536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1280/2578] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:38 2021] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:38.669717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.681976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378d01-7354-46e2-b100-88d2f4b353a5 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.745132 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.745804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.746088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.746363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.747078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.749319 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.861083 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1299/2579] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:38 2021] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:38.866132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.876336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a02f70-f68f-4619-b372-423116e3491b admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.881293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.881972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.882239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.882519 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.883273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.884865 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:38.897371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1281/2580] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:38.901553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:38.912600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c8869-7de0-4575-aa34-38795ac764e1 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:38.919797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:38.920534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:38.920815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:38.921089 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] PATH_INFO: `/v3/projects/3498c5abe5fe4204946c219ba9a8d113/users/32233d25601f42d0b9928fcb84134d93/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:38.937951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3498c5abe5fe4204946c219ba9a8d113, user_id=32233d25601f42d0b9928fcb84134d93, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:38.940789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:39.080941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1300/2581] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:38 2021] PUT /identity/v3/projects/3498c5abe5fe4204946c219ba9a8d113/users/32233d25601f42d0b9928fcb84134d93/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:39.085548 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:39.095439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874526-eb69-4c2c-9646-628656223946 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:39.153131 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef7889-91c6-4841-936b-6a7b137abedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:39.153939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef7889-91c6-4841-936b-6a7b137abedc admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:39.154294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef7889-91c6-4841-936b-6a7b137abedc admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:39.154594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef7889-91c6-4841-936b-6a7b137abedc admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:39.155575 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef7889-91c6-4841-936b-6a7b137abedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:39.156934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef7889-91c6-4841-936b-6a7b137abedc admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:39.171299 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1282/2582] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:39 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:39.172472 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:39.183742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d51fd-dad2-4278-93e7-ae6e7c84c6d3 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:39.189257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:39.190137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:39.190413 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:39.190720 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] PATH_INFO: `/v3/projects/3498c5abe5fe4204946c219ba9a8d113/users/32233d25601f42d0b9928fcb84134d93/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:39.192714 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3498c5abe5fe4204946c219ba9a8d113, user_id=32233d25601f42d0b9928fcb84134d93, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:39.195365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:39.206217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1301/2583] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:39 2021] PUT /identity/v3/projects/3498c5abe5fe4204946c219ba9a8d113/users/32233d25601f42d0b9928fcb84134d93/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:39.218178 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:39.218514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:39.218802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:39.246714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] MFA Rules not processed for user `32233d25601f42d0b9928fcb84134d93`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:39.247973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:39.316969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1283/2584] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:39 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:39.327397 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:39.329078 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:39.392361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b6abc-2901-4bcf-a3e4-77b3bf06746c admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:39.398097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:39.398791 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:39.399075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:39.399352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:39.408909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:39.410554 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:39.419833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1302/2585] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:39 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:39.526949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:39.536710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4dad-6036-4866-898a-c13593d0db10 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:39.540313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04650bf-269b-49f5-a66a-58a6cef1074a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:39.540954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04650bf-269b-49f5-a66a-58a6cef1074a service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:39.541238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04650bf-269b-49f5-a66a-58a6cef1074a service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:39.541518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04650bf-269b-49f5-a66a-58a6cef1074a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:39.597633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04650bf-269b-49f5-a66a-58a6cef1074a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:39.599013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04650bf-269b-49f5-a66a-58a6cef1074a service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:39.607761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1284/2586] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:39 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:45.081829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:45.141254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65beab-31fb-4551-9435-0132afe61842 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:45.145959 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:45.146841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:45.147123 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:45.147402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] PATH_INFO: `/v3/users/2f0913d086694d37be7377384aef8af6` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:45.148570 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0913d086694d37be7377384aef8af6)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:45.151063 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:45.350169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0913d086694d37be7377384aef8af6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:45.350169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0913d086694d37be7377384aef8af6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:45.428568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0913d086694d37be7377384aef8af6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:45.429184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0913d086694d37be7377384aef8af6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:45.445648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0913d086694d37be7377384aef8af6'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:45.459431 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1303/2587] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:45 2021] DELETE /identity/v3/users/2f0913d086694d37be7377384aef8af6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:45.464675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:45.465150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:45.465274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:45.482293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:45.483531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:45.540759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1285/2588] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:45.550943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:45.552680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:45.608266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358bec8-fd6c-4a8c-85f3-b2bfce67719f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:45.611880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:45.612534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:45.612815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:45.613122 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:45.622889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:45.624313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:45.633659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1304/2589] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:46.082679 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:46.084106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:46.097632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768c6fd-20d3-4460-a04e-b3838d649e75 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:46.102698 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:46.106161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:46.106161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:46.106161 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] PATH_INFO: `/v3/projects/163ad99cb55c4a0bb36bee90c7a824fc` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:46.107290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=163ad99cb55c4a0bb36bee90c7a824fc)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:46.109435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:46.277545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163ad99cb55c4a0bb36bee90c7a824fc', 'request_id': 'req-0b6259c2-e688-41a5-b963-37ca055d05cd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.283658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163ad99cb55c4a0bb36bee90c7a824fc', 'request_id': 'req-0b6259c2-e688-41a5-b963-37ca055d05cd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.365970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163ad99cb55c4a0bb36bee90c7a824fc', 'request_id': 'req-0b6259c2-e688-41a5-b963-37ca055d05cd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.377932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] The token cache is being invalidate because project 163ad99cb55c4a0bb36bee90c7a824fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:46.378218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.378866 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.380423 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1286/2590] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:46 2021] DELETE /identity/v3/projects/163ad99cb55c4a0bb36bee90c7a824fc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:46.384836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:46.394620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52613c01-08c9-4ca4-ae5a-2551203ebef3 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:46.449659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:46.450653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:46.450961 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:46.451238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] PATH_INFO: `/v3/users/fe7e53f855874e4ea3fc855ebc3703b4` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:46.452414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7e53f855874e4ea3fc855ebc3703b4)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:46.454331 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:46.599614 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7e53f855874e4ea3fc855ebc3703b4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.600296 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7e53f855874e4ea3fc855ebc3703b4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.662934 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7e53f855874e4ea3fc855ebc3703b4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.666508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7e53f855874e4ea3fc855ebc3703b4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.678071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7e53f855874e4ea3fc855ebc3703b4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:46.692424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1305/2591] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:46 2021] DELETE /identity/v3/users/fe7e53f855874e4ea3fc855ebc3703b4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:47.307040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:47.308685 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:47.321790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6259c2-e688-41a5-b963-37ca055d05cd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:47.378823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:47.379754 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:47.380037 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:47.380316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] PATH_INFO: `/v3/projects/d1f467cb1fca41569b323766e5a31fd0` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:47.381527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f467cb1fca41569b323766e5a31fd0)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:47.383470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:47.506007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f467cb1fca41569b323766e5a31fd0', 'request_id': 'req-59ea61af-ec15-4828-9705-2af0d8db1e21'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.512389 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f467cb1fca41569b323766e5a31fd0', 'request_id': 'req-59ea61af-ec15-4828-9705-2af0d8db1e21'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.583210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f467cb1fca41569b323766e5a31fd0', 'request_id': 'req-59ea61af-ec15-4828-9705-2af0d8db1e21'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.594034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] The token cache is being invalidate because project d1f467cb1fca41569b323766e5a31fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:47.598474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.598474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.598474 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1287/2592] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:47 2021] DELETE /identity/v3/projects/d1f467cb1fca41569b323766e5a31fd0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:47.601396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:47.602920 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:47.616124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852414a6-42d0-4830-96e7-e3a0413f4a9e admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:47.670055 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:47.670955 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:47.671241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:47.671513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] PATH_INFO: `/v3/users/32233d25601f42d0b9928fcb84134d93` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:47.672866 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32233d25601f42d0b9928fcb84134d93)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:47.674665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:47.850128 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32233d25601f42d0b9928fcb84134d93'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.850763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32233d25601f42d0b9928fcb84134d93'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.937889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32233d25601f42d0b9928fcb84134d93'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.940855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32233d25601f42d0b9928fcb84134d93'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.955022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-21e9d451-0885-4467-9c7b-d4b33f0d3d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32233d25601f42d0b9928fcb84134d93'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:47.967509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1306/2593] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:47 2021] DELETE /identity/v3/users/32233d25601f42d0b9928fcb84134d93 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:48.403305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:48.404790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:48.419304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea61af-ec15-4828-9705-2af0d8db1e21 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:48.478682 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:48.479546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:48.479854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:48.480126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] PATH_INFO: `/v3/projects/3498c5abe5fe4204946c219ba9a8d113` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:48.481287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3498c5abe5fe4204946c219ba9a8d113)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:48.483214 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:48.584965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3498c5abe5fe4204946c219ba9a8d113', 'request_id': 'req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:48.591900 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3498c5abe5fe4204946c219ba9a8d113', 'request_id': 'req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:48.657468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3498c5abe5fe4204946c219ba9a8d113', 'request_id': 'req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:48.668735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] The token cache is being invalidate because project 3498c5abe5fe4204946c219ba9a8d113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:48.668947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:48.669632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-c5cc6684-ea44-4ea8-ab9c-23bc0464d681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:48.671200 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1288/2594] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:48 2021] DELETE /identity/v3/projects/3498c5abe5fe4204946c219ba9a8d113 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:10:48.678385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:48.680782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:48.680782 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:48.698470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:48.699709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:48.761499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1307/2595] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:10:48.770179 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:48.770462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:48.770764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:48.789231 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:48.790471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:48.798892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1289/2596] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:48.803551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:48.813738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59285b8-eadc-447b-971e-4d314dfa10f5 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:48.818322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:48.819015 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:48.819299 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:48.819572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:48.820321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:10:48.820652 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:48.822845 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:48.834493 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1308/2597] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:10:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:10:48.839210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:48.848820 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17fb8-0ebb-4b84-ab24-8f98f191fe0d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:48.854087 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:48.854800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:48.855093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:48.855369 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:48.856079 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:48.858046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:48.937274 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1290/2598] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:10:48 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:10:48.941266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:48.952919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fad49d-c6d5-4581-9044-dbd9a65dd814 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:49.010270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:49.010982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:49.011265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:49.011537 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:49.012216 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:49.014110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:49.123862 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1309/2599] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:10:48 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:10:49.128167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:49.139212 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e78c-50ac-4737-a850-145a7377b1f7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:49.146127 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:49.146839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:49.147130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:49.147410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:49.148144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:49.149759 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:49.162404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1291/2600] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:49 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:49.167394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:49.177605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f685f6-cfa8-4206-b68c-4e669dc78814 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:49.183519 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116bf50-a415-4248-8c85-e4b9d17c9a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:49.184219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116bf50-a415-4248-8c85-e4b9d17c9a3d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:49.184475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116bf50-a415-4248-8c85-e4b9d17c9a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:49.184757 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116bf50-a415-4248-8c85-e4b9d17c9a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:49.185485 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116bf50-a415-4248-8c85-e4b9d17c9a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:49.187136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116bf50-a415-4248-8c85-e4b9d17c9a3d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:49.197662 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1310/2601] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:10:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:10:49.201220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:49.211308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0417b9-c951-48d3-baa3-88a161d225d8 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:49.215923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:49.216800 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:49.217081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:49.217355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] PATH_INFO: `/v3/projects/9c1d6dcf628441fd97b33c48539eaf1a/users/e9f18cf9bbab4104b51b0a1a31ef36cc/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:49.233930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1d6dcf628441fd97b33c48539eaf1a, user_id=e9f18cf9bbab4104b51b0a1a31ef36cc, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:49.236633 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:49.323566 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1292/2602] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:10:49 2021] PUT /identity/v3/projects/9c1d6dcf628441fd97b33c48539eaf1a/users/e9f18cf9bbab4104b51b0a1a31ef36cc/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:49.407669 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:49.408243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:49.408704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:49.437114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] MFA Rules not processed for user `e9f18cf9bbab4104b51b0a1a31ef36cc`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:49.438342 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:49.508815 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1311/2603] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:49 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:49.520118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:49.521844 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:49.580059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d91648-a242-4b90-b735-c499a9a8425d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:49.583736 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7013b-44de-4236-98eb-27aecfb0efe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:49.584377 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7013b-44de-4236-98eb-27aecfb0efe5 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:49.584655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7013b-44de-4236-98eb-27aecfb0efe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:49.584924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7013b-44de-4236-98eb-27aecfb0efe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:49.594184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7013b-44de-4236-98eb-27aecfb0efe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:49.595629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7013b-44de-4236-98eb-27aecfb0efe5 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:49.604990 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1293/2604] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:49 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:53.849838 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:53.911933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb33ac6-838f-462d-9836-202f6a010b90 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:53.918114 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:53.919087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:53.919380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:53.919659 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] PATH_INFO: `/v3/users/e9f18cf9bbab4104b51b0a1a31ef36cc` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:53.920863 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f18cf9bbab4104b51b0a1a31ef36cc)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:53.922826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:54.163038 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f18cf9bbab4104b51b0a1a31ef36cc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:54.163693 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f18cf9bbab4104b51b0a1a31ef36cc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:54.240603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f18cf9bbab4104b51b0a1a31ef36cc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:54.241487 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f18cf9bbab4104b51b0a1a31ef36cc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:54.256094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f18cf9bbab4104b51b0a1a31ef36cc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:54.269054 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1312/2605] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:10:53 2021] DELETE /identity/v3/users/e9f18cf9bbab4104b51b0a1a31ef36cc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:10:54.273560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:54.274106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:54.274106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:54.292940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:10:54.294254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:54.354415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1294/2606] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:10:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:10:54.364685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:54.366172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:54.429929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167721fb-cfa0-4bb1-9151-61c3aec37779 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:54.433735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:54.434411 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:54.434829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:54.435107 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:54.444704 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:54.446146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:54.456820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1313/2607] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:10:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:10:54.905421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:10:54.906889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:10:54.919262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c99986-0e74-4a59-b73f-bd3653eedd68 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:10:54.924126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:10:54.925007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:10:54.925298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:10:54.925573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] PATH_INFO: `/v3/projects/9c1d6dcf628441fd97b33c48539eaf1a` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:10:54.927128 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1d6dcf628441fd97b33c48539eaf1a)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:10:54.929046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:10:55.092783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1d6dcf628441fd97b33c48539eaf1a', 'request_id': 'req-9fb6d792-8bf3-4c92-8d66-d61be99db9af'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:55.099133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1d6dcf628441fd97b33c48539eaf1a', 'request_id': 'req-9fb6d792-8bf3-4c92-8d66-d61be99db9af'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:55.175315 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1d6dcf628441fd97b33c48539eaf1a', 'request_id': 'req-9fb6d792-8bf3-4c92-8d66-d61be99db9af'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:55.188468 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] The token cache is being invalidate because project 9c1d6dcf628441fd97b33c48539eaf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:10:55.188774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:55.189444 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-9fb6d792-8bf3-4c92-8d66-d61be99db9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:10:55.191046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1295/2608] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:10:54 2021] DELETE /identity/v3/projects/9c1d6dcf628441fd97b33c48539eaf1a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:11:21.232962 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:11:21.234616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:21.248381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a364-3c11-490a-8171-cd10215a005d service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:11:21.309497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:11:21.310389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:11:21.310710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:11:21.310985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] PATH_INFO: `/v3/users/ff3bef628cc748d58ee6fd4d8fd683e2` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:11:21.312805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3bef628cc748d58ee6fd4d8fd683e2)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:11:21.314817 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:11:21.630238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3bef628cc748d58ee6fd4d8fd683e2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:21.630238 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3bef628cc748d58ee6fd4d8fd683e2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:21.714712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3bef628cc748d58ee6fd4d8fd683e2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:21.715600 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3bef628cc748d58ee6fd4d8fd683e2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:21.727833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3bef628cc748d58ee6fd4d8fd683e2'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:21.741566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1314/2609] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:11:21 2021] DELETE /identity/v3/users/ff3bef628cc748d58ee6fd4d8fd683e2 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:11:21.747189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:11:21.747671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:11:21.747775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:11:21.770586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:11:21.771829 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:21.830710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1296/2610] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:11:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:11:21.840881 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:11:21.842287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:21.898946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80874-025b-4dad-b0f7-13e1d3d6365a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:11:21.902849 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5d7f9-5a29-4311-a4e3-a3102f5875f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:11:21.903495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d7f9-5a29-4311-a4e3-a3102f5875f7 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:11:21.903951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d7f9-5a29-4311-a4e3-a3102f5875f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:11:21.904131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5d7f9-5a29-4311-a4e3-a3102f5875f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:11:21.913202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5d7f9-5a29-4311-a4e3-a3102f5875f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:11:21.914883 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5d7f9-5a29-4311-a4e3-a3102f5875f7 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:11:21.924636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1315/2611] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:11:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:11:22.398038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:11:22.399656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:22.419364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793b48-819d-4897-a884-63f8698d6eaa None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:11:22.428594 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:11:22.429611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:11:22.430366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:11:22.430832 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] PATH_INFO: `/v3/projects/3bdddfb4859a4e3ebd630dd12db76045` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:11:22.432882 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bdddfb4859a4e3ebd630dd12db76045)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:11:22.436316 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:11:22.549513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bdddfb4859a4e3ebd630dd12db76045', 'request_id': 'req-d86ca323-4bbf-4d74-b73f-af21a6dc2709'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:22.556013 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bdddfb4859a4e3ebd630dd12db76045', 'request_id': 'req-d86ca323-4bbf-4d74-b73f-af21a6dc2709'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:22.623325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bdddfb4859a4e3ebd630dd12db76045', 'request_id': 'req-d86ca323-4bbf-4d74-b73f-af21a6dc2709'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:22.634484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] The token cache is being invalidate because project 3bdddfb4859a4e3ebd630dd12db76045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:11:22.634810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:22.635788 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:11:22.637281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1297/2612] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:11:22 2021] DELETE /identity/v3/projects/3bdddfb4859a4e3ebd630dd12db76045 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:11:26.409019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:11:26.409508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:11:26.409627 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:11:26.428146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] MFA Rules not processed for user `6463ded3d09e4dbd908f0d03b20e0555`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:11:26.429356 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:26.482938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1316/2613] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:11:26 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:11:46.765188 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:11:46.767196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:46.842918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ca323-4bbf-4d74-b73f-af21a6dc2709 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:11:46.848355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:11:46.849003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:11:46.849283 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:11:46.849557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:11:46.851745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:11:46.864976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:11:46.866710 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:11:46.878392 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1298/2614] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:11:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:02.070936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:02.072237 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:02.129638 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9234ba-7cfb-4526-9bc6-41e38142abee None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:02.133300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:02.133935 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:02.134214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:02.134486 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:02.136257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:02.194046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:02.195503 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72131f-7bec-4ad4-adec-f4b7a20dc357 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:02.205585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1317/2615] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:02 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:05.982480 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:05.984419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:06.057827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0dac-b704-4662-9ed2-bcc083979d95 service nova] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:06.066466 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:06.067385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:06.067670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:06.067948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:06.069758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:06.082190 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:06.083878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:06.093889 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1299/2616] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:05 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:07.296841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:07.297340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:07.297475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:07.315444 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:12:07.316655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:07.372634 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1318/2617] 10.222.0.73 () {58 vars in 968 bytes} [Fri Aug 27 04:12:07 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:12:07.536074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:07.537472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:07.602778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca220076-e701-45c4-bf86-469db3d96299 service placement] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:07.607843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:07.608483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:07.608827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:07.609046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:07.617467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:07.619124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:07.627724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1300/2618] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:12:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:12:08.900303 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:08.901786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:08.959491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca155e46-e2f1-436f-a2db-f902d0b242c6 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:08.963098 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:08.963744 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:08.964026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:08.964302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:08.966041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:09.026889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:09.028334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:09.039743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1319/2619] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:16.950735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:16.952170 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:16.968407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cd2e-b3c0-4083-8f9c-fdcb9b92985e service swift] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:16.973342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:16.974265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:16.974549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:16.974848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] PATH_INFO: `/v3/users/ee2fe0b619014522a8bd2bcaf7378660` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:16.976044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2fe0b619014522a8bd2bcaf7378660)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:16.977956 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:17.192011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2fe0b619014522a8bd2bcaf7378660'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.264386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2fe0b619014522a8bd2bcaf7378660'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.277706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2fe0b619014522a8bd2bcaf7378660'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.278380 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2fe0b619014522a8bd2bcaf7378660'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.279031 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2fe0b619014522a8bd2bcaf7378660'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.291678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1301/2620] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:12:16 2021] DELETE /identity/v3/users/ee2fe0b619014522a8bd2bcaf7378660 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:17.540162 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:17.552104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30245c-414b-49bd-9a38-cf3055c2ab21 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:17.608429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:17.609852 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:17.610143 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:17.610417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] PATH_INFO: `/v3/projects/28d44e8045c24df28323402022ac9228` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:17.611732 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d44e8045c24df28323402022ac9228)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:17.613637 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:17.722383 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d44e8045c24df28323402022ac9228', 'request_id': 'req-94b16309-6ba9-421a-a108-849bd185338f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.793335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d44e8045c24df28323402022ac9228', 'request_id': 'req-94b16309-6ba9-421a-a108-849bd185338f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.799636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d44e8045c24df28323402022ac9228', 'request_id': 'req-94b16309-6ba9-421a-a108-849bd185338f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.810625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] The token cache is being invalidate because project 28d44e8045c24df28323402022ac9228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:12:17.810917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.811555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:17.813163 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1320/2621] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:12:17 2021] DELETE /identity/v3/projects/28d44e8045c24df28323402022ac9228 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:17.817191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:17.818622 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:17.831944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e62ae-a008-4b45-8f17-0cbea0ac1705 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:17.885611 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:17.886471 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:17.886780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:17.887048 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] PATH_INFO: `/v3/users/5a6c0184ff3345e38ca192d0f5abe0a4` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:17.888426 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6c0184ff3345e38ca192d0f5abe0a4)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:17.890337 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:18.087643 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6c0184ff3345e38ca192d0f5abe0a4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.172969 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6c0184ff3345e38ca192d0f5abe0a4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.185746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6c0184ff3345e38ca192d0f5abe0a4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.186386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6c0184ff3345e38ca192d0f5abe0a4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.187021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6c0184ff3345e38ca192d0f5abe0a4'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.200254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1302/2622] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:12:17 2021] DELETE /identity/v3/users/5a6c0184ff3345e38ca192d0f5abe0a4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:12:18.466166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:18.467712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:18.481890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16309-6ba9-421a-a108-849bd185338f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:18.538980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:18.539842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:18.540126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:18.540403 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] PATH_INFO: `/v3/projects/8db3c287e9874042b689ed03a4c7bd16` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:18.541572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db3c287e9874042b689ed03a4c7bd16)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:18.543557 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:18.692629 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db3c287e9874042b689ed03a4c7bd16', 'request_id': 'req-feabd3d4-ec43-4190-ba1d-907314f30ef7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.761786 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db3c287e9874042b689ed03a4c7bd16', 'request_id': 'req-feabd3d4-ec43-4190-ba1d-907314f30ef7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.768809 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db3c287e9874042b689ed03a4c7bd16', 'request_id': 'req-feabd3d4-ec43-4190-ba1d-907314f30ef7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.779663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] The token cache is being invalidate because project 8db3c287e9874042b689ed03a4c7bd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:12:18.779946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.780591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:18.782740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1321/2623] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:12:18 2021] DELETE /identity/v3/projects/8db3c287e9874042b689ed03a4c7bd16 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:30.594158 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:30.595598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:30.660717 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3641-1a56-403e-bbff-dbef7d0ec4c7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:30.710870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:30.711529 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:30.711811 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:30.712088 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:30.713878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:30.774510 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:30.775919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:30.785132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1303/2624] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:30 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:37.105556 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:37.107004 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:37.120013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabd3d4-ec43-4190-ba1d-907314f30ef7 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:37.123540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:37.124186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:37.124467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:37.124740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:37.126440 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:37.186569 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:37.193561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:37.198126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1322/2625] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:45.183163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:45.184663 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:45.200115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689691b2-8b35-48cc-91b7-2744a117cd49 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:45.204660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:45.205531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:45.205815 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:45.206092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] PATH_INFO: `/v3/users/0c8e2b8a0f3f49f4a3e20160ec0b0193` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:45.207552 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8e2b8a0f3f49f4a3e20160ec0b0193)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:45.209440 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:45.407304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8e2b8a0f3f49f4a3e20160ec0b0193'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:45.490272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8e2b8a0f3f49f4a3e20160ec0b0193'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:45.502817 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8e2b8a0f3f49f4a3e20160ec0b0193'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:45.503461 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8e2b8a0f3f49f4a3e20160ec0b0193'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:45.504117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8e2b8a0f3f49f4a3e20160ec0b0193'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:45.516278 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1304/2626] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:12:45 2021] DELETE /identity/v3/users/0c8e2b8a0f3f49f4a3e20160ec0b0193 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:45.776901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:45.788814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de8cde-a8e7-479b-9f6d-05ae9a44a99c service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:45.845661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:45.846522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:45.847014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:45.847245 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] PATH_INFO: `/v3/projects/43ccefac7f3746c68214be66026da43d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:45.848257 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ccefac7f3746c68214be66026da43d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:45.850310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:45.955813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ccefac7f3746c68214be66026da43d', 'request_id': 'req-ac04988f-b226-4bcb-b422-bc944e2d6e17'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.053628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ccefac7f3746c68214be66026da43d', 'request_id': 'req-ac04988f-b226-4bcb-b422-bc944e2d6e17'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.060840 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ccefac7f3746c68214be66026da43d', 'request_id': 'req-ac04988f-b226-4bcb-b422-bc944e2d6e17'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.072372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] The token cache is being invalidate because project 43ccefac7f3746c68214be66026da43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:12:46.072663 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.073332 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.074911 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1323/2627] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:12:45 2021] DELETE /identity/v3/projects/43ccefac7f3746c68214be66026da43d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:46.078901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:46.080560 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:46.095105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe197-5ac9-4bd4-b7eb-cd02026d88ea admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:46.156431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:46.157311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:46.157593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:46.157868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] PATH_INFO: `/v3/users/85acbeb120214833aa161e0bcefa7941` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:46.159081 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85acbeb120214833aa161e0bcefa7941)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:46.161954 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:46.337553 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85acbeb120214833aa161e0bcefa7941'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.418541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85acbeb120214833aa161e0bcefa7941'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.432503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85acbeb120214833aa161e0bcefa7941'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.433169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85acbeb120214833aa161e0bcefa7941'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.433780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-73f60827-73ce-4d47-bcc9-1d4d1dd3a922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85acbeb120214833aa161e0bcefa7941'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.446169 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1305/2628] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:12:46 2021] DELETE /identity/v3/users/85acbeb120214833aa161e0bcefa7941 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:46.703280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:46.704726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:46.730687 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04988f-b226-4bcb-b422-bc944e2d6e17 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:46.797921 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:46.798834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:46.799110 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:46.799380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] PATH_INFO: `/v3/projects/9edf0e56c7d440b0845f017b93a19da0` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:46.800571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edf0e56c7d440b0845f017b93a19da0)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:46.802925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:46.893142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edf0e56c7d440b0845f017b93a19da0', 'request_id': 'req-d9e7e52a-e334-4b9e-98a4-3fd516128e87'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.947138 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edf0e56c7d440b0845f017b93a19da0', 'request_id': 'req-d9e7e52a-e334-4b9e-98a4-3fd516128e87'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.952871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edf0e56c7d440b0845f017b93a19da0', 'request_id': 'req-d9e7e52a-e334-4b9e-98a4-3fd516128e87'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.964543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] The token cache is being invalidate because project 9edf0e56c7d440b0845f017b93a19da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:12:46.964834 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.966317 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d9e7e52a-e334-4b9e-98a4-3fd516128e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:12:46.967106 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1324/2629] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:12:46 2021] DELETE /identity/v3/projects/9edf0e56c7d440b0845f017b93a19da0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:46.974831 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:46.975116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:46.975400 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:46.996114 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:12:46.997863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:47.057861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1306/2630] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:12:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:12:47.065396 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.065690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.065973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.085434 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:12:47.086664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:47.094613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1325/2631] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:12:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:12:47.099565 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.108929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611792de-66f5-44d2-824d-068c884e5a2b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.115182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.115855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.116139 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.116415 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.117140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:12:47.117445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.119257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.132952 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1307/2632] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:12:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:12:47.136740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.146646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db728-fddc-43d1-866f-ba9fbbb3baa4 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.151568 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.152228 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.152514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.152792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.153478 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.155407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.263412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1326/2633] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:12:47 2021] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:12:47.267670 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.278239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae6872-d78c-4992-812b-fcb9d0452f6f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.336732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.337409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.337695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.338269 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.338694 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.340649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.445704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1308/2634] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:12:47 2021] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:12:47.449976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.461465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b32c-5355-4711-b747-2e90487c43a8 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.466345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.467060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.467348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.467626 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.468391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.470000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.481725 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1327/2635] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:12:47.485797 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.497340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca9b33-b33c-4669-b632-e4ce27d4bc70 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.502232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301bf2a-76d8-455f-9c43-af21d6cbbe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.502232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301bf2a-76d8-455f-9c43-af21d6cbbe45 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.502232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301bf2a-76d8-455f-9c43-af21d6cbbe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.505020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301bf2a-76d8-455f-9c43-af21d6cbbe45 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.505020 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301bf2a-76d8-455f-9c43-af21d6cbbe45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.505620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301bf2a-76d8-455f-9c43-af21d6cbbe45 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.515549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1309/2636] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:12:47.519991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.530806 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf3ca-4240-4f17-8835-60f8ff73bed0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.537925 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.538846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.539818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.539818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] PATH_INFO: `/v3/projects/98836f9ced7149bc904274a5add221ec/users/37ca683634884d9f8af26dba5bbea16f/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.554738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=98836f9ced7149bc904274a5add221ec, user_id=37ca683634884d9f8af26dba5bbea16f, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.557408 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.676513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1328/2637] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:12:47 2021] PUT /identity/v3/projects/98836f9ced7149bc904274a5add221ec/users/37ca683634884d9f8af26dba5bbea16f/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:12:47.682495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0d7df-8912-420b-ade4-1e1fbbb91cf2 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.683875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0d7df-8912-420b-ade4-1e1fbbb91cf2 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.683875 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0d7df-8912-420b-ade4-1e1fbbb91cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.701349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-5ac0d7df-8912-420b-ade4-1e1fbbb91cf2 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:12:47.702614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-5ac0d7df-8912-420b-ade4-1e1fbbb91cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:47.759505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1310/2638] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:12:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:12:47.769471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:47.771320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:47.826882 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c1e5-1dbd-4516-941a-4084773260fa admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:47.830594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:47.831284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:47.831563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:47.831835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:47.841441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:47.842905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:47.852685 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1329/2639] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:12:53.072582 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.073098 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.073288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.129671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] MFA Rules not processed for user `37ca683634884d9f8af26dba5bbea16f`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:12:53.131935 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:53.215994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1311/2640] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:12:53 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:12:53.221142 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:53.232513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c4c71-2537-4ef4-a6c9-c39cce1aa153 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:53.241609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:53.242288 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.242603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.242879 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.243618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:53.245655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:53.366820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1330/2641] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:12:53 2021] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:12:53.371083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:53.383232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320803-4c8b-4150-b39b-b86f536e70a1 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:53.446229 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:53.446955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.447234 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.447503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.448313 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:53.450395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:53.540592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1312/2642] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:12:53 2021] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:12:53.544686 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:53.556085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219886-f885-41a2-a652-a052532ee110 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:53.560954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:53.561664 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.561967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.562231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.563013 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:53.564609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:53.577726 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1331/2643] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:12:53.582648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:53.598058 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2080c-535b-4d2a-9049-9eb7dfacabfa admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:53.603093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:53.604024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.604305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.604578 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] PATH_INFO: `/v3/projects/1b50a01b70ed4f92ae4fedd0a6cdf699/users/18c2b6076dea40f49e55cd1295a7b0df/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.621238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b50a01b70ed4f92ae4fedd0a6cdf699, user_id=18c2b6076dea40f49e55cd1295a7b0df, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:53.623953 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:53.708535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1313/2644] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:12:53 2021] PUT /identity/v3/projects/1b50a01b70ed4f92ae4fedd0a6cdf699/users/18c2b6076dea40f49e55cd1295a7b0df/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:12:53.709309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:53.720753 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae009cb-c525-408b-bb7c-8b27a0bb94bc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:53.781435 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20820ca0-cf15-488b-859f-2ae7bca11074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:53.782186 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20820ca0-cf15-488b-859f-2ae7bca11074 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.782467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20820ca0-cf15-488b-859f-2ae7bca11074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.782778 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20820ca0-cf15-488b-859f-2ae7bca11074 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.783511 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20820ca0-cf15-488b-859f-2ae7bca11074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:53.785289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20820ca0-cf15-488b-859f-2ae7bca11074 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:53.796632 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1332/2645] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:12:53.801411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:53.812605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabf94f-52e0-49f1-8beb-bb8421b15c0a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:12:53.819291 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:12:53.820738 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:53.821314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:53.821899 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] PATH_INFO: `/v3/projects/1b50a01b70ed4f92ae4fedd0a6cdf699/users/18c2b6076dea40f49e55cd1295a7b0df/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:53.825472 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b50a01b70ed4f92ae4fedd0a6cdf699, user_id=18c2b6076dea40f49e55cd1295a7b0df, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:12:53.830960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:12:53.843810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1314/2646] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:12:53 2021] PUT /identity/v3/projects/1b50a01b70ed4f92ae4fedd0a6cdf699/users/18c2b6076dea40f49e55cd1295a7b0df/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:12:59.794418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:12:59.794927 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:12:59.795028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:12:59.824113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] MFA Rules not processed for user `18c2b6076dea40f49e55cd1295a7b0df`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:12:59.825365 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:12:59.896159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1333/2647] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:12:59 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:12:59.908770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:12:59.911810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:00.013015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f4a91-ae03-48f8-94e2-ea8773175056 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:00.018989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:00.020357 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:00.020586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:00.020861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:00.081610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:00.084327 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:00.094210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1315/2648] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:12:59 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:16.475456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:16.527156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61882b-fd72-4fca-a44f-c3a1f20546b7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:16.530666 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:16.531315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:16.531596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:16.531868 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:16.533604 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:16.547210 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:16.548640 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:16.560402 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1334/2649] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:17.728631 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:17.737997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15a7cc-8eef-4dd8-8e3a-0f93fbed253f service nova] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:17.742245 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:17.742928 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:17.743211 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:17.743486 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:17.745216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:17.759353 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:17.760780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99120500-c466-4b55-b3d4-f9087e7e2174 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:17.771689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1316/2650] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:27.032350 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:27.040855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89de487-3385-4510-b69a-6e7251dd3444 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:27.046327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:27.047012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:27.047340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:27.047609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:27.049325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:27.128034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:27.129620 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041778b2-bdf9-4306-abef-16feebc30480 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:27.139256 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1335/2651] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:27 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:29.665093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:29.665664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:29.665664 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:29.683784 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] MFA Rules not processed for user `37ca683634884d9f8af26dba5bbea16f`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:13:29.685027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:29.692326 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1317/2652] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:13:29 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:13:29.984209 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:29.985855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:29.985855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:30.006789 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:13:30.008025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:30.020008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:30.030210 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180998c-b4e9-451f-8a17-db6081a50db1 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:30.034282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:30.035155 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:30.035442 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:30.035745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:30.038495 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:30.049737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:30.051232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:30.062842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1318/2653] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:30.075851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1336/2654] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:13:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:13:30.233025 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:30.234508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:30.320997 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bb9a-dc77-4a0c-869a-86b095590d16 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:30.326196 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec8c47-fe8d-47af-8e53-9d47bb3b30ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:30.326939 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec8c47-fe8d-47af-8e53-9d47bb3b30ad service swift] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:30.327226 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec8c47-fe8d-47af-8e53-9d47bb3b30ad service swift] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:30.327539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec8c47-fe8d-47af-8e53-9d47bb3b30ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:30.339513 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec8c47-fe8d-47af-8e53-9d47bb3b30ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:30.341534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec8c47-fe8d-47af-8e53-9d47bb3b30ad service swift] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:30.352716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1319/2655] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:13:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:30.873535 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:30.874972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:30.970103 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb539cc-7a85-4e5f-925b-6d6b4e38bde7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:30.983388 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:30.984481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:30.985045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:30.985425 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:30.988205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:31.016823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:31.018462 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecde47-d425-44c9-9bb4-ff5c52e0c0e9 service placement] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:31.030131 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1337/2656] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:47.526453 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3c482-6ec7-47d2-93c3-f3a2caf2e979 None None] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:47.526959 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3c482-6ec7-47d2-93c3-f3a2caf2e979 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:47.527107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3c482-6ec7-47d2-93c3-f3a2caf2e979 None None] PATH_INFO: `/` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:47.528932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1320/2657] 10.222.0.73 () {54 vars in 921 bytes} [Fri Aug 27 04:13:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:13:47.533954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:47.534436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:47.534727 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:47.554510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] MFA Rules not processed for user `bb32cee436d24774b51fa67a73ef342d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:13:47.555940 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:47.565247 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1338/2658] 10.222.0.73 () {58 vars in 1019 bytes} [Fri Aug 27 04:13:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:13:47.577570 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3c482-6ec7-47d2-93c3-f3a2caf2e979 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:47.579289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-17f3c482-6ec7-47d2-93c3-f3a2caf2e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:47.634705 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3c482-6ec7-47d2-93c3-f3a2caf2e979 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:47.638191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355d9a-20b1-4d20-855f-73ca52adbf91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:47.638860 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355d9a-20b1-4d20-855f-73ca52adbf91 service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:47.639146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355d9a-20b1-4d20-855f-73ca52adbf91 service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:47.639418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355d9a-20b1-4d20-855f-73ca52adbf91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:47.649166 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355d9a-20b1-4d20-855f-73ca52adbf91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:47.650606 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355d9a-20b1-4d20-855f-73ca52adbf91 service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:47.660842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1321/2659] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:49.715792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:49.717293 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:49.729517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfd8ee-3514-4241-88a4-7032ff7d5d48 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:49.733174 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:49.733828 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:49.734113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:49.734387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:49.744467 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:49.746119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:49.757223 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1339/2660] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:13:49 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:13:50.176362 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:50.176895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:50.176895 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:50.199262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:13:50.200505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:13:50.207905 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1322/2661] 10.222.0.73 () {58 vars in 1010 bytes} [Fri Aug 27 04:13:50 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:13:50.221873 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:13:50.234200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff81570-5875-4bd8-96d1-0b53e0720072 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:13:50.239173 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:13:50.239823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:13:50.240738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:13:50.240901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:13:50.249482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:13:50.251130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:13:50.260424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1340/2662] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:13:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:14:03.809297 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:14:03.819203 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf004-3cfe-4fc6-b073-e690ecef3ddb None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:14:03.823096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:14:03.823764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:14:03.824071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:14:03.824328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:14:03.826113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:14:03.836282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:14:03.837727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2dbf7-c5c5-4325-8b67-3e58d4b72000 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:14:03.845601 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1323/2663] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:14:03 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:14:09.008941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:14:09.011067 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:14:09.027860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb37e8-64e4-497b-ac33-079c5ff745f6 service swift] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:14:09.033613 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:14:09.034263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:14:09.034546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:14:09.034851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:14:09.036635 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:14:09.049950 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:14:09.051498 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:14:09.063129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1341/2664] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:14:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:14:11.029001 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:14:11.029462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:14:11.029563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:14:11.047885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] MFA Rules not processed for user `8bd4fc72719c45568c1a2018a1457e42`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:14:11.049085 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:14:11.057507 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1324/2665] 10.222.0.73 () {58 vars in 968 bytes} [Fri Aug 27 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:14:11.070492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:14:11.082379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf20cd-035b-46bf-8ee9-2232c36e8703 service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:14:11.087575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8946263bd74d445f81944be54ef96070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:14:11.088212 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:14:11.088491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:14:11.088761 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:14:11.096689 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:14:11.098262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:14:11.106851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1342/2666] 10.222.0.73 () {60 vars in 1385 bytes} [Fri Aug 27 04:14:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:15:20.491115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:20.544601 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82fb96-d364-43c2-8ae4-7bd54ec9c46b None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:20.548213 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:20.548981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:20.549271 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:20.549551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:20.551587 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:20.596976 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:20.598842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:20.611528 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1325/2667] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:15:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:15:25.975751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:26.004910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97649570-9df7-4e5b-b109-82a09562b021 service swift] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:26.009323 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:26.009975 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:26.010259 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:26.010534 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:26.012324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:26.093963 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:26.095353 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:26.114722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1343/2668] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:15:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:15:29.808479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:29.809947 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:29.840648 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d63d3-f76f-4bd1-ac76-b6532265215d service nova] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:29.845279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:29.846191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:29.846421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:29.846732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] PATH_INFO: `/v3/users/6463ded3d09e4dbd908f0d03b20e0555` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:29.847901 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6463ded3d09e4dbd908f0d03b20e0555)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:29.850012 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:30.074950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6463ded3d09e4dbd908f0d03b20e0555'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.150885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6463ded3d09e4dbd908f0d03b20e0555'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.163286 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6463ded3d09e4dbd908f0d03b20e0555'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.164104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6463ded3d09e4dbd908f0d03b20e0555'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.164864 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b31f31bf-d2cf-4fa1-8329-cd0c1db9025f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6463ded3d09e4dbd908f0d03b20e0555'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.177038 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1326/2669] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:15:29 2021] DELETE /identity/v3/users/6463ded3d09e4dbd908f0d03b20e0555 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:15:30.450232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:30.463764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df165cc-c38d-475c-af10-ae4b28f9c9e2 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:30.516618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:30.517469 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:30.517747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:30.518014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] PATH_INFO: `/v3/projects/74bc40decbba46aba88aa9c29c8858d2` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:30.519195 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bc40decbba46aba88aa9c29c8858d2)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:30.521091 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:30.614390 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bc40decbba46aba88aa9c29c8858d2', 'request_id': 'req-38c0c7d7-7839-43ee-befc-a5f6731fbed7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.671280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bc40decbba46aba88aa9c29c8858d2', 'request_id': 'req-38c0c7d7-7839-43ee-befc-a5f6731fbed7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.677445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bc40decbba46aba88aa9c29c8858d2', 'request_id': 'req-38c0c7d7-7839-43ee-befc-a5f6731fbed7'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.689717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] The token cache is being invalidate because project 74bc40decbba46aba88aa9c29c8858d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:15:30.690002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.690647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-38c0c7d7-7839-43ee-befc-a5f6731fbed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:15:30.692166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1344/2670] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:15:30 2021] DELETE /identity/v3/projects/74bc40decbba46aba88aa9c29c8858d2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:15:30.702509 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:30.702777 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:30.703054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:30.751220 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:15:30.752438 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:30.809964 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1327/2671] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:15:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:15:30.818271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:30.818647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:30.818949 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:30.837943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:15:30.839181 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:30.847137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1345/2672] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:15:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:15:30.851980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:30.861437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127eb1-6a2a-4d1e-98c6-71306b53177a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:30.865996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:30.867287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:30.867707 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:30.867981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:30.868713 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:15:30.869016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:30.870613 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:30.881650 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1328/2673] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:15:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:15:30.886177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:30.895285 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45bd03-4a11-45a2-b67a-12c2706a4b9e None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:30.900708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:30.901364 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:30.901650 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:30.901929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:30.902642 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:30.904551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:30.999910 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1346/2674] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:15:30 2021] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:15:31.004116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:31.015533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830e098-13b8-4cac-9a05-45f26a9fdb8f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:31.071709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:31.072376 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:31.072658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:31.072930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:31.073620 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:31.075550 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:31.129057 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1329/2675] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:15:31 2021] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:15:31.133249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:31.143580 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857051d5-f2f5-484e-a648-be3775e22860 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:31.149636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:31.150418 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:31.150655 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:31.150938 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:31.151679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:31.153307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:31.165561 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1347/2676] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:15:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:15:31.169757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:31.180290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafde56-3487-4e1b-b5b1-51adc49162df admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:31.185809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4a179-70c2-47fa-b228-5a404ea7ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:31.186521 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4a179-70c2-47fa-b228-5a404ea7ec60 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:31.186855 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4a179-70c2-47fa-b228-5a404ea7ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:31.187137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4a179-70c2-47fa-b228-5a404ea7ec60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:31.187902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4a179-70c2-47fa-b228-5a404ea7ec60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:31.189675 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4a179-70c2-47fa-b228-5a404ea7ec60 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:31.200580 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1330/2677] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:15:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:15:31.204710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:31.216476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fe747-34c5-47ef-b516-fd2431aebf9a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:31.221297 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:31.222182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:31.222465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:31.222766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] PATH_INFO: `/v3/projects/0e215cb584e04408bc95d37a5c81d1de/users/1eee45d5e088466d8ebf58a9755ea45d/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:31.238113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e215cb584e04408bc95d37a5c81d1de, user_id=1eee45d5e088466d8ebf58a9755ea45d, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:31.240788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:31.295560 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1348/2678] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:15:31 2021] PUT /identity/v3/projects/0e215cb584e04408bc95d37a5c81d1de/users/1eee45d5e088466d8ebf58a9755ea45d/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:15:31.300755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14b3e-8a57-4f35-aec2-6c61d38b64cc None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:31.307176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14b3e-8a57-4f35-aec2-6c61d38b64cc None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:31.307176 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14b3e-8a57-4f35-aec2-6c61d38b64cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:31.321963 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d9d14b3e-8a57-4f35-aec2-6c61d38b64cc None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:15:31.323913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d9d14b3e-8a57-4f35-aec2-6c61d38b64cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:31.385145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1331/2679] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:15:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:15:31.395968 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:31.397751 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:31.464639 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d8a1b-3902-40e9-bb93-b775b006934d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:31.468351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:31.468996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:31.469280 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:31.469555 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:31.478811 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:31.480281 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:31.489694 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1349/2680] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:15:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:15:37.000647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3d65e-5f08-4c37-aadc-56a25e644ec8 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:37.001182 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3d65e-5f08-4c37-aadc-56a25e644ec8 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:37.001284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3d65e-5f08-4c37-aadc-56a25e644ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:37.032778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-aee3d65e-5f08-4c37-aadc-56a25e644ec8 None None] MFA Rules not processed for user `1eee45d5e088466d8ebf58a9755ea45d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:15:37.034109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-aee3d65e-5f08-4c37-aadc-56a25e644ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:37.101850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1332/2681] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:15:36 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:15:37.113515 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:15:37.114980 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:37.207855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540741dc-56ae-4891-9d8e-307b1b8226e4 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:15:37.214188 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a5901-453a-489c-9787-fc9c74049ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:15:37.214886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5901-453a-489c-9787-fc9c74049ed5 service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:37.215167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5901-453a-489c-9787-fc9c74049ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:37.215445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5901-453a-489c-9787-fc9c74049ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:37.229185 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5901-453a-489c-9787-fc9c74049ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:15:37.230986 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5901-453a-489c-9787-fc9c74049ed5 service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:15:37.242577 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1350/2682] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:15:37 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:15:39.863960 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:15:39.864455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:15:39.864655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:15:39.897189 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] MFA Rules not processed for user `1eee45d5e088466d8ebf58a9755ea45d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:15:39.900002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:15:39.908730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1333/2683] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:15:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:16:13.521917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:13.522494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:13.522494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:13.540386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] MFA Rules not processed for user `37ca683634884d9f8af26dba5bbea16f`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:13.541598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:13.596585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1351/2684] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:16:13 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:16:13.929796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:13.931418 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:13.943756 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b947a6-95f9-4922-acb0-598e12543087 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:13.947364 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:13.948005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:13.948287 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:13.948557 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:13.950371 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:13.961491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:13.965090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:13.971511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1334/2685] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:16:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:17:40.215265 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.216665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:40.304722 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ecde-af14-4bb9-a835-6eea2cdda792 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.309797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.310454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.310768 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.311042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.312798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:40.324842 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:40.326432 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dc232-169e-4fc1-8e94-16b96313337f service placement] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:40.337025 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1352/2686] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:17:40 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:18:52.944919 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:52.946425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:53.024321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e6957-2905-45c1-a645-5f58e8dc6347 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:53.028049 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:53.028695 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.028974 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.029248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.031055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:53.043137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:53.044563 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:53.054409 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1335/2687] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:18:52 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:19:05.616141 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.616674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.616674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.634214 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] MFA Rules not processed for user `37ca683634884d9f8af26dba5bbea16f`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:05.635595 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:05.642917 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1353/2688] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:19:05 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:19:05.681838 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:05.683413 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:05.695809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c17141-bf24-47eb-91b8-e7184144b741 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.699807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:05.700454 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.700732 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.701002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.702848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:05.741032 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:05.742489 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:05.763042 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1336/2689] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:19:06.050313 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:06.060324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4120fc-7fc7-46cf-b9fb-6269271a9b04 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:06.064670 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:06.065327 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:06.065603 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:06.065878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:06.067679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:06.077385 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:06.082226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:06.083735 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:06.087303 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29270b12-5d91-4b85-8f7b-85cc890fae30 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:06.091146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:06.091787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:06.092063 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:06.092339 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:06.094096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:06.094792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1354/2690] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:19:06.106262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:06.107725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:06.116217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1337/2691] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:06 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:19:06.871137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:06.882276 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361c40-63ad-47f4-967b-72c90923cb95 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:06.887850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:06.888556 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:06.889998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:06.889998 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:06.890924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:06.911052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:06.914120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:06.933790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1355/2692] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:06 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:19:10.768863 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:10.777747 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e316-de49-4515-931a-77530ac062c6 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:10.781602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:10.784846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:10.784846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:10.784846 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:10.785365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:10.795696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:10.797238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:10.806358 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1338/2693] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:10 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:19:24.588436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:24.602094 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad956-0eeb-434f-9f46-f921c26fcedb service placement] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:24.608032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:24.608690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:24.608972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:24.609258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:24.611596 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:24.624139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:24.626263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:24.636837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1356/2694] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:19:28.263861 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:28.273238 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fd563-6bbd-4fe6-992b-c6e266d1d944 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:28.277024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:28.277671 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:28.277961 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:28.278239 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:28.280066 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:28.345340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:28.346813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:28.356854 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1339/2695] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:28 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:19:30.631320 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:30.632861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:30.647262 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0899f1-6070-4cdd-8634-e293b2b41aec service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:30.655884 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:30.656993 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:30.657279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:30.657563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:30.661989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:30.685068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:30.687258 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:30.700793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1357/2696] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:19:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:20:39.469708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:20:39.478944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd1c5-4bb2-4e67-b28a-4d4654c22b1b service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:20:39.483388 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3772-6c34-4a60-8159-f442aefe407a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:20:39.484028 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3772-6c34-4a60-8159-f442aefe407a service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:20:39.484311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3772-6c34-4a60-8159-f442aefe407a service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:20:39.484586 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3772-6c34-4a60-8159-f442aefe407a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:20:39.492744 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3772-6c34-4a60-8159-f442aefe407a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:20:39.494160 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3772-6c34-4a60-8159-f442aefe407a service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:20:39.503115 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1340/2697] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:20:39 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:20:43.399772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:20:43.410847 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30693-f99d-4c2e-80b9-698f533fbaea service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:20:43.416524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:20:43.417172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:20:43.417499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:20:43.417775 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:20:43.419563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:20:43.433335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:20:43.435012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:20:43.449359 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1358/2698] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:20:43 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:20:47.818809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:20:47.819496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:20:47.819496 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:20:47.836636 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] MFA Rules not processed for user `1eee45d5e088466d8ebf58a9755ea45d`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:20:47.837839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:20:47.845511 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1341/2699] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:20:47 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:21:47.217508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:47.228933 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353210-f709-4de7-a312-9d0e25c14e4d service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:47.234333 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:47.235027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:47.235309 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:47.235585 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:47.237347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:47.252653 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:47.254104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:47.265497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1359/2700] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:21:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:21:54.807715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:54.816770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:54.824279 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f7518-cc4a-4b51-813f-49963c263e25 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:54.829055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:54.829929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:54.830207 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:54.830479 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] PATH_INFO: `/v3/users/37ca683634884d9f8af26dba5bbea16f` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:54.831683 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ca683634884d9f8af26dba5bbea16f)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:54.833839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:55.019632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ca683634884d9f8af26dba5bbea16f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.074724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ca683634884d9f8af26dba5bbea16f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.087407 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ca683634884d9f8af26dba5bbea16f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.088083 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ca683634884d9f8af26dba5bbea16f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.088692 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ca683634884d9f8af26dba5bbea16f'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.100787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1342/2701] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:21:54 2021] DELETE /identity/v3/users/37ca683634884d9f8af26dba5bbea16f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:21:55.382116 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:55.397802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0f2d-7f29-4d19-944d-a94e8f5d646b service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:55.464985 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:55.465878 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:55.466168 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:55.466442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] PATH_INFO: `/v3/projects/98836f9ced7149bc904274a5add221ec` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:55.467723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98836f9ced7149bc904274a5add221ec)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:55.469710 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:55.594798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98836f9ced7149bc904274a5add221ec', 'request_id': 'req-b61fb1b3-60ea-4122-9871-78576fbf90e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.657783 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98836f9ced7149bc904274a5add221ec', 'request_id': 'req-b61fb1b3-60ea-4122-9871-78576fbf90e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.664326 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98836f9ced7149bc904274a5add221ec', 'request_id': 'req-b61fb1b3-60ea-4122-9871-78576fbf90e5'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.675028 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] The token cache is being invalidate because project 98836f9ced7149bc904274a5add221ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:21:55.675318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.675957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:55.678310 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1360/2702] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:21:55 2021] DELETE /identity/v3/projects/98836f9ced7149bc904274a5add221ec => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:21:55.682770 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:55.684195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:55.697821 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7283d4-370f-402c-a146-babb0dc47902 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:55.758741 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:55.759720 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:55.760008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:55.760285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] PATH_INFO: `/v3/users/18c2b6076dea40f49e55cd1295a7b0df` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:55.761457 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c2b6076dea40f49e55cd1295a7b0df)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:55.763414 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:55.957761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c2b6076dea40f49e55cd1295a7b0df'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.023787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c2b6076dea40f49e55cd1295a7b0df'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.036823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c2b6076dea40f49e55cd1295a7b0df'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.037605 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c2b6076dea40f49e55cd1295a7b0df'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.038235 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c2b6076dea40f49e55cd1295a7b0df'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.050064 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1343/2703] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:21:55 2021] DELETE /identity/v3/users/18c2b6076dea40f49e55cd1295a7b0df => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:21:56.304032 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:56.305802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:56.319957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fb1b3-60ea-4122-9871-78576fbf90e5 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:56.374119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:56.395973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:56.395973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:56.395973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] PATH_INFO: `/v3/projects/1b50a01b70ed4f92ae4fedd0a6cdf699` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:56.395973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b50a01b70ed4f92ae4fedd0a6cdf699)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:56.395973 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:56.606086 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b50a01b70ed4f92ae4fedd0a6cdf699', 'request_id': 'req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.737335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b50a01b70ed4f92ae4fedd0a6cdf699', 'request_id': 'req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.743954 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b50a01b70ed4f92ae4fedd0a6cdf699', 'request_id': 'req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.759278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] The token cache is being invalidate because project 1b50a01b70ed4f92ae4fedd0a6cdf699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:21:56.759625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.760298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:21:56.761916 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1361/2704] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:21:56 2021] DELETE /identity/v3/projects/1b50a01b70ed4f92ae4fedd0a6cdf699 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:22:46.085431 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:22:46.087027 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:22:46.156661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3f89-b241-4c6e-9a88-b189c35caead admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:22:46.217980 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:22:46.218533 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:22:46.218842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:22:46.219118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:22:46.220839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:22:46.232044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:22:46.233661 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:22:46.244053 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1344/2705] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:22:46 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:11.264341 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:11.265736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:11.320218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4dfb6-da8b-4775-9fee-69b4aea5c7fc admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:11.323867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:11.324516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:11.324801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:11.325082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:11.326832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:11.386648 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:11.388079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:11.398169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1362/2706] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:15.107437 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:15.108918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:15.122783 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63198-c7be-44bc-816a-8f263bf0dd31 service placement] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:15.127429 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:15.128289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:15.128571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:15.128848 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] PATH_INFO: `/v3/users/1eee45d5e088466d8ebf58a9755ea45d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:15.130051 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eee45d5e088466d8ebf58a9755ea45d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:15.132535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:15.303491 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eee45d5e088466d8ebf58a9755ea45d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.370406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eee45d5e088466d8ebf58a9755ea45d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.382970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eee45d5e088466d8ebf58a9755ea45d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.383629 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eee45d5e088466d8ebf58a9755ea45d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.384234 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-40124715-d5d6-4f4f-989b-035672bfee6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eee45d5e088466d8ebf58a9755ea45d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.397615 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1345/2707] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:23:15 2021] DELETE /identity/v3/users/1eee45d5e088466d8ebf58a9755ea45d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:15.652361 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:15.663737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae14ba-19f5-47cd-a923-aad507767b36 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:15.722252 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:15.723169 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:15.723457 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:15.723737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] PATH_INFO: `/v3/projects/0e215cb584e04408bc95d37a5c81d1de` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:15.725513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e215cb584e04408bc95d37a5c81d1de)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:15.727456 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:15.851164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e215cb584e04408bc95d37a5c81d1de', 'request_id': 'req-cb2863a7-41c4-440f-95b9-873f4a7549f3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.913005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e215cb584e04408bc95d37a5c81d1de', 'request_id': 'req-cb2863a7-41c4-440f-95b9-873f4a7549f3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.918793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e215cb584e04408bc95d37a5c81d1de', 'request_id': 'req-cb2863a7-41c4-440f-95b9-873f4a7549f3'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.929424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] The token cache is being invalidate because project 0e215cb584e04408bc95d37a5c81d1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:23:15.929712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.930625 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-cb2863a7-41c4-440f-95b9-873f4a7549f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:15.932146 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1363/2708] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:23:15 2021] DELETE /identity/v3/projects/0e215cb584e04408bc95d37a5c81d1de => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:15.938077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:15.938367 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:15.938678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:15.966284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:15.967498 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:16.023609 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1346/2709] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:16.031547 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.031841 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.032124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.050278 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:16.051509 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:16.059698 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1364/2710] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:23:16.063810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.073714 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66c67-d405-44f0-add2-94c9ca4ef810 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.078308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.078991 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.079272 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.079543 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.080256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:23:16.080559 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.082133 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.093765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1347/2711] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:23:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:23:16.097900 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.107070 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8e73-aab0-4660-a12a-09e49d673785 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.111708 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.112384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.112665 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.112941 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.113621 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.115742 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.263330 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1365/2712] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:23:16 2021] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:16.267827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.278455 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd7b37-f899-475f-bc3d-f6455def7613 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.331825 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.332482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.332763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.333039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.334417 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.336349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.421372 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1348/2713] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:23:16 2021] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:16.425417 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.436898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cf9ac-0fdb-4b9d-b7a0-21247be65bcb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.441495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.442152 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.442455 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.443381 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.444190 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.445779 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.456420 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1366/2714] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:16.460345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.470101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607eaf-a5d2-4dcc-aea2-f25515c1c18a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.474762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556454fc-8f8a-47a8-9f9c-c73fb53a0b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.475412 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556454fc-8f8a-47a8-9f9c-c73fb53a0b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.475712 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556454fc-8f8a-47a8-9f9c-c73fb53a0b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.475977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556454fc-8f8a-47a8-9f9c-c73fb53a0b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.476700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556454fc-8f8a-47a8-9f9c-c73fb53a0b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.478342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556454fc-8f8a-47a8-9f9c-c73fb53a0b17 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.488024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1349/2715] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:16.492840 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.502500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5ede4-4e19-4131-8f11-70a1f43559f0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.508087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.508958 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.509242 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.509523 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] PATH_INFO: `/v3/projects/bef102b62ab14c66bf90d68cf5b4cf95/users/028882a63f83452c950b7bd751f4b255/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.523797 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef102b62ab14c66bf90d68cf5b4cf95, user_id=028882a63f83452c950b7bd751f4b255, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.526377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.592836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1367/2716] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:16 2021] PUT /identity/v3/projects/bef102b62ab14c66bf90d68cf5b4cf95/users/028882a63f83452c950b7bd751f4b255/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:23:16.606973 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.607293 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.607572 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.634003 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] MFA Rules not processed for user `028882a63f83452c950b7bd751f4b255`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:16.635242 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:16.696398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1350/2717] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:16 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:23:16.707905 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:16.709602 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:16.779249 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88aec-ecb3-4d8f-8c80-e156f5a54e6f admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:16.784740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec519b-9faf-42e1-ad66-497631d4e66c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:16.785385 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec519b-9faf-42e1-ad66-497631d4e66c service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:16.785668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec519b-9faf-42e1-ad66-497631d4e66c service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:16.785982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec519b-9faf-42e1-ad66-497631d4e66c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:16.793453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec519b-9faf-42e1-ad66-497631d4e66c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:16.795060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec519b-9faf-42e1-ad66-497631d4e66c service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:16.804165 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1368/2718] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:16 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:16.982925 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:17.044039 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0048-79ca-4e66-a3eb-80987ef4774c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:17.048684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:17.049545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:17.049823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:17.050092 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] PATH_INFO: `/v3/users/028882a63f83452c950b7bd751f4b255` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:17.051228 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028882a63f83452c950b7bd751f4b255)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:17.053321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:17.257942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028882a63f83452c950b7bd751f4b255'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:17.319803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028882a63f83452c950b7bd751f4b255'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:17.332040 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028882a63f83452c950b7bd751f4b255'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:17.332687 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028882a63f83452c950b7bd751f4b255'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:17.333217 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028882a63f83452c950b7bd751f4b255'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:17.345504 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1351/2719] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:23:16 2021] DELETE /identity/v3/users/028882a63f83452c950b7bd751f4b255 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:17.350532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:17.350851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:17.354760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:17.369437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:17.370679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:17.426601 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1369/2720] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:17.437152 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:17.438731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:17.495318 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6aed-8157-44cf-8289-c6ecc0521d76 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:17.499044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f67a-ab10-4048-bd63-1d0fe5675a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:17.499688 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f67a-ab10-4048-bd63-1d0fe5675a59 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:17.499971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f67a-ab10-4048-bd63-1d0fe5675a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:17.500249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f67a-ab10-4048-bd63-1d0fe5675a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:17.510142 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f67a-ab10-4048-bd63-1d0fe5675a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:17.511610 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f67a-ab10-4048-bd63-1d0fe5675a59 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:17.521487 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1352/2721] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:17.994609 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:17.996219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:18.008459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d84543-54ca-43c9-abf2-a1538451681f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.013068 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.013929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.014207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.014691 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] PATH_INFO: `/v3/projects/bef102b62ab14c66bf90d68cf5b4cf95` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.015875 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef102b62ab14c66bf90d68cf5b4cf95)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.017802 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.118349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef102b62ab14c66bf90d68cf5b4cf95', 'request_id': 'req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:18.169923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef102b62ab14c66bf90d68cf5b4cf95', 'request_id': 'req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:18.175324 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef102b62ab14c66bf90d68cf5b4cf95', 'request_id': 'req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:18.186352 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] The token cache is being invalidate because project bef102b62ab14c66bf90d68cf5b4cf95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:23:18.186674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:18.187348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e8fd85c-8a66-462b-ac1e-7ba0ee6092bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:18.188908 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1370/2722] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:23:17 2021] DELETE /identity/v3/projects/bef102b62ab14c66bf90d68cf5b4cf95 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:18.194617 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.194906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.195199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.214021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:18.216842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:18.272093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1353/2723] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:23:18.280041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.280340 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.280619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.300191 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:18.301391 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:18.309459 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1371/2724] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:18.313531 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:18.323567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1179e-e933-4a98-8e34-2295725325a0 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.328193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.328843 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.329121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.348579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.348579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:23:18.348579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.348579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.348579 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1354/2725] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:23:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:23:18.351676 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:18.360795 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aab8dd-cb24-409e-b209-a1fd51294e32 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.365837 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.366522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.366831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.367101 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.367772 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.369654 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.479507 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1372/2726] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:23:18 2021] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:18.483342 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:18.493929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ee7c-52b1-48a0-a9e3-2154de3dda8d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.551837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.552514 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.552796 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.553071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.553778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.555970 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.696730 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1355/2727] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:23:18 2021] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:18.700813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:18.710915 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f8714-105c-415e-b3fe-4a1336a92ded admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.715369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.716021 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.716302 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.716578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.717295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.718890 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.729011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1373/2728] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:18.732999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:18.743285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61931cba-94b2-42fe-af28-629d1289b852 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.747892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b985f5-a805-4648-afcb-01fa21628662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.748536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b985f5-a805-4648-afcb-01fa21628662 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.748818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b985f5-a805-4648-afcb-01fa21628662 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.749096 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b985f5-a805-4648-afcb-01fa21628662 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.749814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b985f5-a805-4648-afcb-01fa21628662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.751435 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b985f5-a805-4648-afcb-01fa21628662 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.762145 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1356/2729] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:23:18.766263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:18.776002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fda0d-2aaf-45ad-be34-d6e225eeec0b admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:18.780541 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:18.781410 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.781717 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.781991 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] PATH_INFO: `/v3/projects/829ec8984628404bb358a315c5c72cd5/users/c91c07bfbf0f4e419c65b312c74fa775/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.796097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ec8984628404bb358a315c5c72cd5, user_id=c91c07bfbf0f4e419c65b312c74fa775, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:18.798769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:18.948400 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1374/2730] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:18 2021] PUT /identity/v3/projects/829ec8984628404bb358a315c5c72cd5/users/c91c07bfbf0f4e419c65b312c74fa775/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:18.960311 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:18.960598 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:18.960885 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:18.987005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] MFA Rules not processed for user `c91c07bfbf0f4e419c65b312c74fa775`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:18.988140 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:19.051208 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1357/2731] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:18 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:19.056681 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.117100 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac970-d26c-433e-b59e-c3fa11f06feb admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.122205 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.122895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.123179 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.123453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.124136 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.126027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.240758 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1375/2732] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:23:19 2021] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:19.244737 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.259071 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbdcd0-818c-426d-b3d2-7c6a022114fb None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.316551 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.317215 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.318034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.318325 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.319055 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.320971 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.475000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1358/2733] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:23:19 2021] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:23:19.478929 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.489225 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec8338-ae11-4d14-9678-f8b51d270b69 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.496966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.496966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.496966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.496966 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.497414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.497414 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.507646 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1376/2734] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:19.511926 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.522718 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119514b-0711-4bd4-9a1e-b1248139a212 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.527782 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.528657 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.528942 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.529261 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] PATH_INFO: `/v3/projects/363c0997218a40cdae9137ca604c3ba5/users/0239524d77c54421bb81dfb7fe9d366e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.545427 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363c0997218a40cdae9137ca604c3ba5, user_id=0239524d77c54421bb81dfb7fe9d366e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.548104 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.633755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1359/2735] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:19 2021] PUT /identity/v3/projects/363c0997218a40cdae9137ca604c3ba5/users/0239524d77c54421bb81dfb7fe9d366e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:23:19.637679 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.647651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9c53-79c1-479c-a7db-e14de95cca85 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.700386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb6774-c829-469a-aae0-6c098ff418a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.701042 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb6774-c829-469a-aae0-6c098ff418a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.701321 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb6774-c829-469a-aae0-6c098ff418a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.701599 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb6774-c829-469a-aae0-6c098ff418a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.702307 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb6774-c829-469a-aae0-6c098ff418a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.703919 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb6774-c829-469a-aae0-6c098ff418a2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.713483 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1377/2736] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:19 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:23:19.718243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.730359 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abddc3d-05e8-4967-afd3-69d2fd27d641 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.735034 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.735907 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.736193 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.736470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] PATH_INFO: `/v3/projects/363c0997218a40cdae9137ca604c3ba5/users/0239524d77c54421bb81dfb7fe9d366e/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.738436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363c0997218a40cdae9137ca604c3ba5, user_id=0239524d77c54421bb81dfb7fe9d366e, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.742105 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.752177 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1360/2737] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:19 2021] PUT /identity/v3/projects/363c0997218a40cdae9137ca604c3ba5/users/0239524d77c54421bb81dfb7fe9d366e/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:19.762832 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.767445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.767445 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.789118 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] MFA Rules not processed for user `0239524d77c54421bb81dfb7fe9d366e`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:19.790311 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:19.855126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1378/2738] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:19 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:19.866103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:19.867852 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:19.920772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b58a7-4c2c-4e31-97e4-ae7598d41527 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:19.924378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:19.925005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:19.925300 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:19.925556 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:19.935118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:19.936525 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:19.945785 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1361/2739] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:19 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:20.054551 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:20.056229 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:20.068137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31a6c-bc5e-4352-9f92-a1bbb3f56831 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:20.071724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518819e-c53c-48a5-9037-e3a4753fd3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:20.072362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518819e-c53c-48a5-9037-e3a4753fd3de service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:20.072636 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518819e-c53c-48a5-9037-e3a4753fd3de service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:20.072908 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518819e-c53c-48a5-9037-e3a4753fd3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:20.126119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518819e-c53c-48a5-9037-e3a4753fd3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:20.127572 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518819e-c53c-48a5-9037-e3a4753fd3de service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:20.136398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1379/2740] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:20.381305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:20.443198 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fed60-3303-4c81-a92e-e804791440a2 service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:20.447780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:20.448635 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:20.448914 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:20.449187 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] PATH_INFO: `/v3/users/c91c07bfbf0f4e419c65b312c74fa775` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:20.450345 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91c07bfbf0f4e419c65b312c74fa775)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:20.452263 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:20.627930 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91c07bfbf0f4e419c65b312c74fa775'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:20.711780 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91c07bfbf0f4e419c65b312c74fa775'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:20.723419 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91c07bfbf0f4e419c65b312c74fa775'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:20.724095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91c07bfbf0f4e419c65b312c74fa775'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:20.724735 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91c07bfbf0f4e419c65b312c74fa775'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:20.736571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1362/2741] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:23:20 2021] DELETE /identity/v3/users/c91c07bfbf0f4e419c65b312c74fa775 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:20.741208 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:20.741516 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:20.741798 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:20.760064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:20.761261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:20.816765 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1380/2742] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:20.827490 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:20.828878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:20.883689 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2864-c05b-413b-916c-447113418241 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:20.887256 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:20.887902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:20.888185 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:20.888464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:20.897981 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:20.899824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:20.911944 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1363/2743] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:21.314790 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:21.316592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:21.334193 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc719b7a-46b8-4119-8f78-f3bd57656362 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:21.339097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:21.339970 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:21.340347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:21.340505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] PATH_INFO: `/v3/projects/829ec8984628404bb358a315c5c72cd5` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:21.341760 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829ec8984628404bb358a315c5c72cd5)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:21.343682 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:21.433736 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829ec8984628404bb358a315c5c72cd5', 'request_id': 'req-9535c3bc-2e90-4bce-9201-6e82dfb83da0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.506392 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829ec8984628404bb358a315c5c72cd5', 'request_id': 'req-9535c3bc-2e90-4bce-9201-6e82dfb83da0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.512120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829ec8984628404bb358a315c5c72cd5', 'request_id': 'req-9535c3bc-2e90-4bce-9201-6e82dfb83da0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.523051 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] The token cache is being invalidate because project 829ec8984628404bb358a315c5c72cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:23:21.523339 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.524001 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.525677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1381/2744] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:23:21 2021] DELETE /identity/v3/projects/829ec8984628404bb358a315c5c72cd5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:21.529646 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:21.540467 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e245d0-072d-4997-ad81-7c7cd81e77a7 service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:21.593868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:21.594758 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:21.595044 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:21.595321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] PATH_INFO: `/v3/users/0239524d77c54421bb81dfb7fe9d366e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:21.596492 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0239524d77c54421bb81dfb7fe9d366e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:21.598395 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:21.788521 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0239524d77c54421bb81dfb7fe9d366e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.855612 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0239524d77c54421bb81dfb7fe9d366e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.868074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0239524d77c54421bb81dfb7fe9d366e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.868840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0239524d77c54421bb81dfb7fe9d366e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.869558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a9191c73-08a1-4f4b-93f7-caa96f2172b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0239524d77c54421bb81dfb7fe9d366e'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:21.882978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1364/2745] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:23:21 2021] DELETE /identity/v3/users/0239524d77c54421bb81dfb7fe9d366e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:22.360796 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:22.361660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:22.378702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c3bc-2e90-4bce-9201-6e82dfb83da0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:22.440207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:22.441113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:22.441395 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:22.441668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] PATH_INFO: `/v3/projects/363c0997218a40cdae9137ca604c3ba5` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:22.442904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363c0997218a40cdae9137ca604c3ba5)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:22.444871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:22.564825 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363c0997218a40cdae9137ca604c3ba5', 'request_id': 'req-8b6691f2-0fce-4a27-9584-e61869cc32a4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:22.673060 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363c0997218a40cdae9137ca604c3ba5', 'request_id': 'req-8b6691f2-0fce-4a27-9584-e61869cc32a4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:22.679800 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363c0997218a40cdae9137ca604c3ba5', 'request_id': 'req-8b6691f2-0fce-4a27-9584-e61869cc32a4'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:22.691532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] The token cache is being invalidate because project 363c0997218a40cdae9137ca604c3ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:23:22.691869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:22.692645 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-8b6691f2-0fce-4a27-9584-e61869cc32a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:22.695579 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1382/2746] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:23:22 2021] DELETE /identity/v3/projects/363c0997218a40cdae9137ca604c3ba5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:22.701493 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:22.701764 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:22.702074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:22.721856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:22.723258 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:22.792484 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1365/2747] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:23:22.802992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:22.803406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:22.803695 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:22.822801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:22.824115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:22.832373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1383/2748] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:22.837314 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:22.846915 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae0cd-10a2-43a7-9d89-c195ea7f441c None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:22.852592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:22.853257 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:22.853542 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:22.853818 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:22.854545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:23:22.854881 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:22.856483 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:22.868985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1366/2749] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:23:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:23:22.874076 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:22.887848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5ced-e586-4a22-b074-e391780f1ff7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:22.894421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:22.895363 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:22.897183 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:22.898203 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:22.898951 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:22.901002 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:22.996448 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1384/2750] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:23:22 2021] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:23:23.002252 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:23.013021 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845fc2-b364-426a-b2b4-3fdbdb42b6e7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:23.076951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:23.077627 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:23.077916 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:23.078195 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:23.078931 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:23.081348 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:23.207016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1367/2751] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:23:23 2021] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:23.211880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:23.223407 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9970fa9-ae94-4c34-86ec-146422f8e011 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:23.228064 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:23.228741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:23.229034 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:23.229367 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:23.230043 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:23.231740 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:23.244848 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1385/2752] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:23.248906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:23.261824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bc130-3c3c-4f8c-8068-40c66f17154e admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:23.267632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85101767-4673-4b40-a8ca-0db8fcbb5522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:23.268539 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85101767-4673-4b40-a8ca-0db8fcbb5522 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:23.269074 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85101767-4673-4b40-a8ca-0db8fcbb5522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:23.269365 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85101767-4673-4b40-a8ca-0db8fcbb5522 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:23.270095 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85101767-4673-4b40-a8ca-0db8fcbb5522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:23.271725 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85101767-4673-4b40-a8ca-0db8fcbb5522 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:23.283878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1368/2753] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:23.288416 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:23.298771 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1765e-754a-47d4-95f6-77dec3f51a68 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:23.304284 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:23.305424 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:23.305707 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:23.305982 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] PATH_INFO: `/v3/projects/49e1b83ee8a9490e825e6ca788f3185d/users/bd705bd42f0a45ed96017f6ff760b0cc/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:23.325240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1b83ee8a9490e825e6ca788f3185d, user_id=bd705bd42f0a45ed96017f6ff760b0cc, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:23.330532 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:23.451250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1386/2754] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:23 2021] PUT /identity/v3/projects/49e1b83ee8a9490e825e6ca788f3185d/users/bd705bd42f0a45ed96017f6ff760b0cc/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:23.456298 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8bb8f-e8fc-4b16-a243-54e0db3b4176 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:23.456597 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8bb8f-e8fc-4b16-a243-54e0db3b4176 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:23.456884 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8bb8f-e8fc-4b16-a243-54e0db3b4176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:23.474302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-10a8bb8f-e8fc-4b16-a243-54e0db3b4176 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:23.475555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-10a8bb8f-e8fc-4b16-a243-54e0db3b4176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:23.531332 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1369/2755] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:23.541617 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:23.543510 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:23.597314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff44399-f977-4957-b62f-b93bc5df4897 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:23.601575 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:23.602217 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:23.602500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:23.602805 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:23.611674 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:23.613139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:23.623082 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1387/2756] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:24.842923 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:24.843452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:24.843452 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:24.871602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] MFA Rules not processed for user `bd705bd42f0a45ed96017f6ff760b0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:24.872827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:24.935573 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1370/2757] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:24 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:24.940184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:24.952630 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd70c-98bc-4d9e-ad7b-054d01501912 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:24.957347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:24.958019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:24.958306 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:24.958615 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:24.959588 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:24.961270 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:25.046315 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1388/2758] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:23:24 2021] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:25.050247 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:25.061632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e7cd8-5ab8-4c1b-be03-eab3f78f4e55 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:25.116146 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:25.116734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:25.117011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:25.117281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:25.117965 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:25.119913 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:25.238937 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1371/2759] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:23:25 2021] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:25.246027 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:25.256300 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340420-1200-47d6-a356-21941a7fbd47 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:25.261005 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:25.261668 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:25.261953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:25.262231 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:25.263000 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:25.264597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:25.274829 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1389/2760] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:25.279010 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:25.289335 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd68863-1e26-4700-8a32-6fd4d739b5fa admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:25.293975 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:25.294878 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:25.295167 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:25.295445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] PATH_INFO: `/v3/projects/ff6e914045b746fe923011e11b81ff06/users/bd7d27c60fef419981f96bb2489d842d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:25.310305 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6e914045b746fe923011e11b81ff06, user_id=bd7d27c60fef419981f96bb2489d842d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:25.312996 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:25.404982 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1372/2761] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:25 2021] PUT /identity/v3/projects/ff6e914045b746fe923011e11b81ff06/users/bd7d27c60fef419981f96bb2489d842d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:25.409048 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:25.419591 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe300af4-df15-480c-a1fb-5f111d19fad9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:25.472618 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97036eb-ceb1-401b-8ca1-dcf8fbdacff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:25.473279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97036eb-ceb1-401b-8ca1-dcf8fbdacff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:25.473562 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97036eb-ceb1-401b-8ca1-dcf8fbdacff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:25.473836 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97036eb-ceb1-401b-8ca1-dcf8fbdacff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:25.475202 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97036eb-ceb1-401b-8ca1-dcf8fbdacff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:25.476860 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97036eb-ceb1-401b-8ca1-dcf8fbdacff0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:25.486192 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1390/2762] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:25 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:25.490443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:25.500642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99158ead-75c6-4d61-802e-7dfd55fbcdb3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:25.507093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:25.507093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:25.507093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:25.507093 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] PATH_INFO: `/v3/projects/ff6e914045b746fe923011e11b81ff06/users/bd7d27c60fef419981f96bb2489d842d/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:25.508727 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6e914045b746fe923011e11b81ff06, user_id=bd7d27c60fef419981f96bb2489d842d, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:25.511405 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:25.521233 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1373/2763] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:25 2021] PUT /identity/v3/projects/ff6e914045b746fe923011e11b81ff06/users/bd7d27c60fef419981f96bb2489d842d/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:26.814743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:26.815274 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:26.815379 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:26.842066 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] MFA Rules not processed for user `bd7d27c60fef419981f96bb2489d842d`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:26.843527 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:26.910451 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1391/2764] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:26 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:26.921262 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:26.923270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:26.985307 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d64113-94b7-4ff0-9522-8bf87cc311f6 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:26.989809 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:26.991653 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:26.991940 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:26.992218 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:27.046386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:27.047842 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:27.057366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1374/2765] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:26 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:28.894085 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:28.895508 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:28.907606 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde2982-5625-499e-af2c-5982395e6fe2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:28.911180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:28.912335 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:28.912624 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:28.912901 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:28.921823 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:28.923294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:28.933594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1392/2766] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:28 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:44.391462 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:44.453069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06772a5-80c0-462d-83d0-74db5020506a service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:44.457936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:44.458837 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:44.459120 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:44.459436 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] PATH_INFO: `/v3/users/bd705bd42f0a45ed96017f6ff760b0cc` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:44.460621 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd705bd42f0a45ed96017f6ff760b0cc)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:44.462536 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:44.669199 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd705bd42f0a45ed96017f6ff760b0cc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:44.753153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd705bd42f0a45ed96017f6ff760b0cc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:44.765420 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd705bd42f0a45ed96017f6ff760b0cc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:44.768447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd705bd42f0a45ed96017f6ff760b0cc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:44.768447 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd705bd42f0a45ed96017f6ff760b0cc'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:44.778632 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1375/2767] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:23:44 2021] DELETE /identity/v3/users/bd705bd42f0a45ed96017f6ff760b0cc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:45.021221 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:45.032384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1ecd7-b4c9-48c6-85be-6ab04ece8902 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:45.089712 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:45.090597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:45.090885 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:45.091164 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] PATH_INFO: `/v3/projects/49e1b83ee8a9490e825e6ca788f3185d` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:45.092345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e1b83ee8a9490e825e6ca788f3185d)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:45.094254 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:45.203372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e1b83ee8a9490e825e6ca788f3185d', 'request_id': 'req-c9258880-a39e-4428-9e75-591237e75dd0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.272201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e1b83ee8a9490e825e6ca788f3185d', 'request_id': 'req-c9258880-a39e-4428-9e75-591237e75dd0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.278292 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e1b83ee8a9490e825e6ca788f3185d', 'request_id': 'req-c9258880-a39e-4428-9e75-591237e75dd0'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.288763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] The token cache is being invalidate because project 49e1b83ee8a9490e825e6ca788f3185d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:23:45.289053 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.289684 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.291347 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1393/2768] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:23:45 2021] DELETE /identity/v3/projects/49e1b83ee8a9490e825e6ca788f3185d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:45.295840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:45.296949 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:45.310225 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335fc9-843a-4c49-bb98-66a0e1e877b5 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:45.363807 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:45.364678 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:45.364983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:45.365281 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] PATH_INFO: `/v3/users/bd7d27c60fef419981f96bb2489d842d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:45.366475 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7d27c60fef419981f96bb2489d842d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:45.368473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:45.623393 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7d27c60fef419981f96bb2489d842d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.730451 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7d27c60fef419981f96bb2489d842d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.742614 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7d27c60fef419981f96bb2489d842d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.743244 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7d27c60fef419981f96bb2489d842d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.744126 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-fe168253-40b8-42f8-8dd7-5e953f60b41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7d27c60fef419981f96bb2489d842d'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:45.755888 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1376/2769] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:23:45 2021] DELETE /identity/v3/users/bd7d27c60fef419981f96bb2489d842d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:23:46.000130 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.001563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:46.015305 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258880-a39e-4428-9e75-591237e75dd0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.071497 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.073007 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.073158 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.073429 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] PATH_INFO: `/v3/projects/ff6e914045b746fe923011e11b81ff06` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.074622 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6e914045b746fe923011e11b81ff06)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.076548 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.217121 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6e914045b746fe923011e11b81ff06', 'request_id': 'req-3e82eaa0-66cb-4711-b2ad-df20a6673bda'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:46.295793 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6e914045b746fe923011e11b81ff06', 'request_id': 'req-3e82eaa0-66cb-4711-b2ad-df20a6673bda'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:46.302009 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6e914045b746fe923011e11b81ff06', 'request_id': 'req-3e82eaa0-66cb-4711-b2ad-df20a6673bda'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:46.315318 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] The token cache is being invalidate because project ff6e914045b746fe923011e11b81ff06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:23:46.315564 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:46.316232 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-3e82eaa0-66cb-4711-b2ad-df20a6673bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:23:46.317859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1394/2770] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:23:45 2021] DELETE /identity/v3/projects/ff6e914045b746fe923011e11b81ff06 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:23:46.326724 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.327016 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.327321 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.346709 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:46.347932 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:46.407972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1377/2771] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:23:46.416453 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.416855 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.417019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.436200 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:46.437404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:46.445616 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1395/2772] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:23:46.449972 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.459700 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97f4ed-87a6-48ed-857c-e8a90909827f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.465024 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.465680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.471488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.471488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.471488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:23:46.471488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.471488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.481201 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1378/2773] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:23:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:23:46.485475 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.494441 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac16c0-f9cb-4ff6-83a7-167cbd8306f8 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.499115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.499763 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.500046 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.500322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.500996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.502957 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.588394 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1396/2774] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:23:46 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:46.592403 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.602406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8f21-aa41-499c-8b50-9e68a4e3ea00 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.658324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.659002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.659289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.659571 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.660381 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.662294 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.741918 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1379/2775] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:23:46 2021] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:23:46.746218 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.756398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9064b-031b-4d83-95bc-9585f1aad2ea admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.761865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.762521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.762831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.763150 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.763871 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.765454 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.776295 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1397/2776] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:46.780011 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.789704 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81ccc4-8cfc-41c7-a25b-0c78bfacfbf4 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.794309 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e35f3-a397-41e1-8a64-0255bd828d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.794999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e35f3-a397-41e1-8a64-0255bd828d3c admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.795282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e35f3-a397-41e1-8a64-0255bd828d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.795558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e35f3-a397-41e1-8a64-0255bd828d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.796304 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e35f3-a397-41e1-8a64-0255bd828d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.797872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e35f3-a397-41e1-8a64-0255bd828d3c admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.807760 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1380/2777] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:23:46 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:23:46.813119 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:46.823248 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e675a-93e1-4f59-84bc-f826adf59cb0 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:46.828052 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:46.828969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.829250 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.829526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] PATH_INFO: `/v3/projects/4342bc95ae12494d9866156fdfa2fdb4/users/e299a8c46f60438394c870c1c9b407bd/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.844846 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=4342bc95ae12494d9866156fdfa2fdb4, user_id=e299a8c46f60438394c870c1c9b407bd, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:46.847468 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:46.929592 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1398/2778] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:23:46 2021] PUT /identity/v3/projects/4342bc95ae12494d9866156fdfa2fdb4/users/e299a8c46f60438394c870c1c9b407bd/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:23:46.940221 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:46.940517 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:46.940802 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:46.967406 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] MFA Rules not processed for user `e299a8c46f60438394c870c1c9b407bd`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:23:46.968660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:47.036868 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1381/2779] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:23:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:23:47.048201 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:23:47.049893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:23:47.126702 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d751a2-c207-4339-b8b2-848b47bc9ead admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:23:47.130283 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a5f92-89a9-49e0-aa72-5399254c6dfe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:23:47.130990 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a5f92-89a9-49e0-aa72-5399254c6dfe service glance] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:23:47.131275 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a5f92-89a9-49e0-aa72-5399254c6dfe service glance] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:23:47.131550 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a5f92-89a9-49e0-aa72-5399254c6dfe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:23:47.140290 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a5f92-89a9-49e0-aa72-5399254c6dfe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:23:47.141715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a5f92-89a9-49e0-aa72-5399254c6dfe service glance] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:23:47.150406 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1399/2780] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:23:47 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:13.917117 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:13.978236 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967bbd8-aa50-4e45-aeac-9269fdd5d77e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:13.982929 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:13.983948 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:13.984227 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:13.984500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] PATH_INFO: `/v3/users/e299a8c46f60438394c870c1c9b407bd` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:13.985708 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e299a8c46f60438394c870c1c9b407bd)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:13.987731 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:14.238892 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e299a8c46f60438394c870c1c9b407bd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:14.329450 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e299a8c46f60438394c870c1c9b407bd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:14.341386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e299a8c46f60438394c870c1c9b407bd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:14.342022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e299a8c46f60438394c870c1c9b407bd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:14.343503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e299a8c46f60438394c870c1c9b407bd'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:14.354955 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1382/2781] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:24:13 2021] DELETE /identity/v3/users/e299a8c46f60438394c870c1c9b407bd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:14.359386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:14.359861 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:14.359967 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:14.377022 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:14.378207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:14.434184 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1400/2782] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:14.444144 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:14.445534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:14.582019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc4f5e-a126-4e7f-ae5f-f4bba2dabc88 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:14.582019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a61208-fc68-440c-9c3e-dd15cdaba83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:14.582019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61208-fc68-440c-9c3e-dd15cdaba83e service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:14.582019 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61208-fc68-440c-9c3e-dd15cdaba83e service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:14.582827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61208-fc68-440c-9c3e-dd15cdaba83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:14.582827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a61208-fc68-440c-9c3e-dd15cdaba83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:14.582827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a61208-fc68-440c-9c3e-dd15cdaba83e service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:14.582827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1383/2783] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:15.010754 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.012159 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:15.027738 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e221-65a8-4dce-8723-1b35c90ed73f None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.029346 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.031024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.031377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.031660 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] PATH_INFO: `/v3/projects/4342bc95ae12494d9866156fdfa2fdb4` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.032893 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4342bc95ae12494d9866156fdfa2fdb4)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.034898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:15.232495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4342bc95ae12494d9866156fdfa2fdb4', 'request_id': 'req-c7752148-9f44-4777-8f96-da6a29d32e95'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:15.357393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4342bc95ae12494d9866156fdfa2fdb4', 'request_id': 'req-c7752148-9f44-4777-8f96-da6a29d32e95'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:15.363930 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4342bc95ae12494d9866156fdfa2fdb4', 'request_id': 'req-c7752148-9f44-4777-8f96-da6a29d32e95'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:15.374899 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] The token cache is being invalidate because project 4342bc95ae12494d9866156fdfa2fdb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:24:15.375898 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:15.376543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-c7752148-9f44-4777-8f96-da6a29d32e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:15.378079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1401/2784] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:24:15 2021] DELETE /identity/v3/projects/4342bc95ae12494d9866156fdfa2fdb4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:15.383768 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.384254 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.384355 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.402163 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:15.408309 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:15.464268 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1384/2785] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:15.472987 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.473351 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.474194 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.496737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:15.496737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:15.502924 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1402/2786] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:15.507121 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.516857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72c17b-c167-4a8e-b0f1-b9dcc1644a4f None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.521411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.522072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.522356 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.522690 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.523410 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:15.523790 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.525375 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:15.537616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1385/2787] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:24:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:24:15.541737 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.551605 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aacb13-a091-4d90-9255-dfafe202f3e7 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.556512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.559818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.559818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.559818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.559818 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.560387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:15.666126 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1403/2788] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:15 2021] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:15.670109 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.681775 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ab33f-6409-43c3-9ab7-434555bd7e22 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.736459 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.737118 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.737398 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.737934 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.738642 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.740574 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:15.831567 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1386/2789] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:24:15 2021] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:15.835546 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.847170 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12cc70-d8f7-4c56-ba21-a9a614ebdff2 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.851851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.852517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.852804 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.853084 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.853807 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.855437 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:15.865896 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1404/2790] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:24:15.869592 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.880216 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d4473-de52-4889-9e28-ab8b0f99442a admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.884936 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0def73-dbc2-42b3-b8bf-a6b45846fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.885588 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0def73-dbc2-42b3-b8bf-a6b45846fc2f admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.885872 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0def73-dbc2-42b3-b8bf-a6b45846fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.886150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0def73-dbc2-42b3-b8bf-a6b45846fc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.886938 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0def73-dbc2-42b3-b8bf-a6b45846fc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.888505 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0def73-dbc2-42b3-b8bf-a6b45846fc2f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:15.898508 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1387/2791] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:24:15.902387 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:15.912936 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79150-1f7d-4495-9c11-5cb7d09ce01d admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:15.917500 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:15.918380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:15.918703 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:15.918979 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] PATH_INFO: `/v3/projects/82b26a230dd8416bb377f840f984c36e/users/5cc5c7db7c444acc97291d87dfaa5406/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:15.934334 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b26a230dd8416bb377f840f984c36e, user_id=5cc5c7db7c444acc97291d87dfaa5406, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:15.937011 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.004522 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1405/2792] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:24:15 2021] PUT /identity/v3/projects/82b26a230dd8416bb377f840f984c36e/users/5cc5c7db7c444acc97291d87dfaa5406/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:16.015360 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.015649 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.015924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.041554 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] MFA Rules not processed for user `5cc5c7db7c444acc97291d87dfaa5406`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:16.042781 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:16.105449 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1388/2793] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:16 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:16.109813 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:16.168677 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949edfc-314f-46df-9c5b-1f63b78d59ae admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:16.174036 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:16.174716 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.174999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.175271 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.175953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:16.177867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.341115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1406/2794] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:16 2021] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:16.345757 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:16.358022 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18e9fd-c8c8-4e59-8224-fa9729a5de8a None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:16.410659 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:16.411334 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.411616 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.411891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.412576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:16.414470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.511787 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1389/2795] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:24:16 2021] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:16.515631 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:16.526517 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bcb3d-42a2-4ebb-8f80-9faf9a1acb21 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:16.531243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:16.544172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.544172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.544172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.544172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:16.544172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.545844 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1407/2796] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:24:16.550150 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:16.560288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9ada8-bba0-435a-abcd-a4b46874d51d admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:16.564924 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9998e6-a53c-4ad8-99cc-707125b022e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:16.565576 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9998e6-a53c-4ad8-99cc-707125b022e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.565857 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9998e6-a53c-4ad8-99cc-707125b022e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.566130 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9998e6-a53c-4ad8-99cc-707125b022e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.566891 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9998e6-a53c-4ad8-99cc-707125b022e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:16.568494 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9998e6-a53c-4ad8-99cc-707125b022e7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.578077 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1390/2797] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:24:16.587088 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:16.597369 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef36c-67ac-4c3c-8672-e1a03e84fb19 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:16.601867 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:16.602792 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.603071 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.603345 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] PATH_INFO: `/v3/projects/279eca0b369b473b8bcc4f180ccf1e42/users/967a53951cb3414dab5940e31330e98f/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.617272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279eca0b369b473b8bcc4f180ccf1e42, user_id=967a53951cb3414dab5940e31330e98f, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:16.619880 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.740227 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1408/2798] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:24:16 2021] PUT /identity/v3/projects/279eca0b369b473b8bcc4f180ccf1e42/users/967a53951cb3414dab5940e31330e98f/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:16.750041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db70d5-1362-4942-aace-356c3486295d None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.750331 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db70d5-1362-4942-aace-356c3486295d None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.750645 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db70d5-1362-4942-aace-356c3486295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.778541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-07db70d5-1362-4942-aace-356c3486295d None None] MFA Rules not processed for user `967a53951cb3414dab5940e31330e98f`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:16.779859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-07db70d5-1362-4942-aace-356c3486295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:16.841137 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1391/2799] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:24:16.846087 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:16.903850 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b0d4-43e2-47da-b567-e744bf7e7c09 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:16.908972 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:16.909623 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:16.909907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:16.910180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:16.910895 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:16.912784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:16.995946 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1409/2800] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:16 2021] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:16.997107 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db70d5-1362-4942-aace-356c3486295d None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:17.008132 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db70d5-1362-4942-aace-356c3486295d None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:17.060824 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:17.061481 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.061761 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.062036 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] PATH_INFO: `/v3/users` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.062734 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:17.064993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:17.139985 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1392/2801] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:24:16 2021] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:24:17.144124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:17.154491 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bca0-1773-433b-9202-8096e5e21ffa admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:17.159808 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:17.160465 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.160749 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.161144 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.161865 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:17.163479 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:17.174373 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1410/2802] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:24:17.178265 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:17.188856 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd064f2-61f3-4c74-b6b9-ee7f334ffda3 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:17.193792 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:17.194723 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.195007 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.195284 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] PATH_INFO: `/v3/projects/c3345e1ffeab4a6a82459baca2dce10b/users/d2c631bf94c24634952a84d91eb68522/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.209778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3345e1ffeab4a6a82459baca2dce10b, user_id=d2c631bf94c24634952a84d91eb68522, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:17.212445 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:17.304941 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1393/2803] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:24:17 2021] PUT /identity/v3/projects/c3345e1ffeab4a6a82459baca2dce10b/users/d2c631bf94c24634952a84d91eb68522/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:17.309073 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:17.318989 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3726-c0b8-4d8f-b4ed-26369277671a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:17.371801 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d7e7-4183-4066-a94d-4b94d5eb4fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:17.372458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d7e7-4183-4066-a94d-4b94d5eb4fde admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.372741 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d7e7-4183-4066-a94d-4b94d5eb4fde admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.373026 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d7e7-4183-4066-a94d-4b94d5eb4fde admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.373731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d7e7-4183-4066-a94d-4b94d5eb4fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:17.375362 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d7e7-4183-4066-a94d-4b94d5eb4fde admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:17.385079 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1411/2804] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:17 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:24:17.389243 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:17.400112 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f1a66-6ac6-494d-a2a5-b8463d8de0d7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:17.404808 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:17.405697 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.405983 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.406260 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] PATH_INFO: `/v3/projects/c3345e1ffeab4a6a82459baca2dce10b/users/d2c631bf94c24634952a84d91eb68522/roles/66fa01fc90a4468a8e48a84773bfcd4d` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.408946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3345e1ffeab4a6a82459baca2dce10b, user_id=d2c631bf94c24634952a84d91eb68522, role_id=66fa01fc90a4468a8e48a84773bfcd4d)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:17.411655 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:17.421745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1394/2805] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:24:17 2021] PUT /identity/v3/projects/c3345e1ffeab4a6a82459baca2dce10b/users/d2c631bf94c24634952a84d91eb68522/roles/66fa01fc90a4468a8e48a84773bfcd4d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:24:17.431992 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.432289 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.432574 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.461647 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] MFA Rules not processed for user `d2c631bf94c24634952a84d91eb68522`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:17.462894 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:17.528266 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1412/2806] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:17 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:17.539743 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:17.541706 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:17.598989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd843a-69df-44eb-9e5e-bab69d6aadbd admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:17.602750 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:17.603411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:17.603715 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:17.603989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:17.656558 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:17.658116 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:17.666763 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1395/2807] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:17 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:20.674482 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:20.683943 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddba77-ab16-47a4-8f1d-bb9a03a22fe2 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:20.687566 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:20.688207 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:20.688492 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:20.688769 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:20.742820 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:20.744272 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:20.753496 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1413/2808] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:20 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:22.130110 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:22.138448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f723db2-b995-4d19-a62d-82efff13c80f service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:22.142366 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04b8fc-47d3-4548-a354-c2d634f4f848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:22.143275 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b8fc-47d3-4548-a354-c2d634f4f848 service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:22.143568 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b8fc-47d3-4548-a354-c2d634f4f848 service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:22.143850 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b8fc-47d3-4548-a354-c2d634f4f848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:22.152696 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04b8fc-47d3-4548-a354-c2d634f4f848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:22.154124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04b8fc-47d3-4548-a354-c2d634f4f848 service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:22.164191 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1396/2809] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:22 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:26.841651 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:26.900697 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce23b-d90f-4f64-b2e3-7e7067339a15 service cinder] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:26.905279 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:26.906172 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:26.906458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:26.906764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] PATH_INFO: `/v3/users/5cc5c7db7c444acc97291d87dfaa5406` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:26.907974 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc5c7db7c444acc97291d87dfaa5406)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:26.909889 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.108156 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc5c7db7c444acc97291d87dfaa5406'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:27.108750 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc5c7db7c444acc97291d87dfaa5406'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:27.186481 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc5c7db7c444acc97291d87dfaa5406'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:27.187124 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc5c7db7c444acc97291d87dfaa5406'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:27.200389 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc5c7db7c444acc97291d87dfaa5406'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:27.214294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1414/2810] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:24:26 2021] DELETE /identity/v3/users/5cc5c7db7c444acc97291d87dfaa5406 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:27.220308 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.220879 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.221652 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.239791 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:27.241008 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.297056 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1397/2811] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:27.308322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.309747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.366939 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a72dd-84a9-4694-9aa7-3e60105e515a admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.370553 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.371224 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.371505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.371784 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.380969 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.382399 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.391594 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1415/2812] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:24:27.780124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:27.783288 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:27.795813 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864a8a-81c8-4bfb-9a4a-8692d42bf25e None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:27.800769 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:27.802035 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:27.802425 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:27.802745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] PATH_INFO: `/v3/projects/82b26a230dd8416bb377f840f984c36e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:27.804015 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b26a230dd8416bb377f840f984c36e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:27.806273 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:27.945593 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b26a230dd8416bb377f840f984c36e', 'request_id': 'req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:27.951674 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b26a230dd8416bb377f840f984c36e', 'request_id': 'req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.031564 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b26a230dd8416bb377f840f984c36e', 'request_id': 'req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.042628 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] The token cache is being invalidate because project 82b26a230dd8416bb377f840f984c36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:24:28.042946 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.043562 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.045174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1398/2813] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:24:27 2021] DELETE /identity/v3/projects/82b26a230dd8416bb377f840f984c36e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:28.049166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:28.059287 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d4c0-2c22-445b-8c50-bfbb426ca93f service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:28.112543 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:28.113398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:28.113743 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:28.114012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] PATH_INFO: `/v3/users/967a53951cb3414dab5940e31330e98f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:28.115291 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967a53951cb3414dab5940e31330e98f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:28.117243 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:28.274137 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967a53951cb3414dab5940e31330e98f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.274767 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967a53951cb3414dab5940e31330e98f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.323024 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967a53951cb3414dab5940e31330e98f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.323644 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967a53951cb3414dab5940e31330e98f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.336057 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967a53951cb3414dab5940e31330e98f'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.347723 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1416/2814] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:24:28 2021] DELETE /identity/v3/users/967a53951cb3414dab5940e31330e98f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:24:28.735665 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:28.737181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:28.752693 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300c4ab-fbd3-4f42-b0e8-7b82aef15adb admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:28.809711 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:28.810500 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:28.810814 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:28.811090 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] PATH_INFO: `/v3/projects/279eca0b369b473b8bcc4f180ccf1e42` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:28.812266 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279eca0b369b473b8bcc4f180ccf1e42)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:28.814172 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:28.956619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279eca0b369b473b8bcc4f180ccf1e42', 'request_id': 'req-a7d3cee1-099f-4555-aee6-37a3b4ed5019'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:28.962771 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279eca0b369b473b8bcc4f180ccf1e42', 'request_id': 'req-a7d3cee1-099f-4555-aee6-37a3b4ed5019'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.030470 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279eca0b369b473b8bcc4f180ccf1e42', 'request_id': 'req-a7d3cee1-099f-4555-aee6-37a3b4ed5019'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.041993 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] The token cache is being invalidate because project 279eca0b369b473b8bcc4f180ccf1e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:24:29.042285 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.042951 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.044537 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1399/2815] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:24:28 2021] DELETE /identity/v3/projects/279eca0b369b473b8bcc4f180ccf1e42 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:29.048436 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.049851 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:29.063777 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913d2d-d004-492a-98d7-4dcd2e656275 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.119442 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.120787 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.121241 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.121524 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] PATH_INFO: `/v3/users/d2c631bf94c24634952a84d91eb68522` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.122773 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c631bf94c24634952a84d91eb68522)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:29.124709 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:29.284421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c631bf94c24634952a84d91eb68522'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.285074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c631bf94c24634952a84d91eb68522'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.357452 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c631bf94c24634952a84d91eb68522'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.357996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c631bf94c24634952a84d91eb68522'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.370041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-7ebba496-2dfa-4431-97ed-1ecbe058be9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c631bf94c24634952a84d91eb68522'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:29.382393 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1417/2816] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:24:29 2021] DELETE /identity/v3/users/d2c631bf94c24634952a84d91eb68522 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:29.839421 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:29.841000 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:29.853488 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3cee1-099f-4555-aee6-37a3b4ed5019 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:29.908430 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:29.909277 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:29.909555 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:29.909830 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] PATH_INFO: `/v3/projects/c3345e1ffeab4a6a82459baca2dce10b` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:29.911041 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3345e1ffeab4a6a82459baca2dce10b)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:29.912912 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.003184 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3345e1ffeab4a6a82459baca2dce10b', 'request_id': 'req-e535eaa2-2f69-470f-91ca-7a9fe727c046'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:30.009927 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3345e1ffeab4a6a82459baca2dce10b', 'request_id': 'req-e535eaa2-2f69-470f-91ca-7a9fe727c046'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:30.060181 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3345e1ffeab4a6a82459baca2dce10b', 'request_id': 'req-e535eaa2-2f69-470f-91ca-7a9fe727c046'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:30.071054 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] The token cache is being invalidate because project c3345e1ffeab4a6a82459baca2dce10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:24:30.071340 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:30.071957 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-e535eaa2-2f69-470f-91ca-7a9fe727c046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:24:30.073482 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1400/2817] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:24:29 2021] DELETE /identity/v3/projects/c3345e1ffeab4a6a82459baca2dce10b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:30.079226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.079728 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.079859 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.097624 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:30.099112 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.154097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1418/2818] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:30.162253 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.162545 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.163302 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.181819 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:30.183047 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.190823 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1401/2819] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:30.195701 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.206177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cfe8-47ae-4e00-886c-62c4bbad51ac None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.211180 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.211835 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.212113 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.212380 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.213097 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73793) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:24:30.213398 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.215012 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.226261 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1419/2820] 10.222.0.73 () {58 vars in 1153 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:24:30.230637 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.240729 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc64af-279e-40ea-8910-6bd1ed6e6a33 None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.245602 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.246249 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.246534 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.246841 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] PATH_INFO: `/v3/projects` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.247535 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.249411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.328755 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1402/2821] 10.222.0.73 () {60 vars in 1153 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:30.332690 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.342447 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50ac1-2b31-4e9a-97a9-643cae2659d6 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.395470 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.396139 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.396428 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.396699 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.397372 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.399314 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.492294 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1420/2822] 10.222.0.73 () {60 vars in 1144 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:24:30.496439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.507290 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d668-b63f-41c5-bd3d-3e102e1cb517 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.512180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.512853 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.513134 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.513411 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.514138 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.515762 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.526289 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1403/2823] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:24:30.530298 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.540869 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bbf3d-a367-49b1-b0cf-2308925c0ce9 admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.545512 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58269291-9143-4cc1-8330-4857a1975356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.546167 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58269291-9143-4cc1-8330-4857a1975356 admin admin] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.546450 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58269291-9143-4cc1-8330-4857a1975356 admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.546764 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58269291-9143-4cc1-8330-4857a1975356 admin admin] PATH_INFO: `/v3/roles` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.547540 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58269291-9143-4cc1-8330-4857a1975356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.549120 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58269291-9143-4cc1-8330-4857a1975356 admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.560525 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1421/2824] 10.222.0.73 () {58 vars in 1122 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:24:30.564590 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.574541 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab38d4-2189-4017-9fd8-00b47fdd2f21 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.579174 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.580075 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.580361 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.580639 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] PATH_INFO: `/v3/projects/acdf99bfe4454bd190356a3a79f0041f/users/00fb86d834c5405ea06e6c79ef712c25/roles/322777f2a56841baaad99b09485c4a0e` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.594746 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdf99bfe4454bd190356a3a79f0041f, user_id=00fb86d834c5405ea06e6c79ef712c25, role_id=322777f2a56841baaad99b09485c4a0e)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.597386 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.687378 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1404/2825] 10.222.0.73 () {60 vars in 1483 bytes} [Fri Aug 27 04:24:30 2021] PUT /identity/v3/projects/acdf99bfe4454bd190356a3a79f0041f/users/00fb86d834c5405ea06e6c79ef712c25/roles/322777f2a56841baaad99b09485c4a0e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:24:30.692421 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55137-b66e-4b06-afa0-5b82d476262a None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.692713 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55137-b66e-4b06-afa0-5b82d476262a None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.692996 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55137-b66e-4b06-afa0-5b82d476262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.711199 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-66f55137-b66e-4b06-afa0-5b82d476262a None None] MFA Rules not processed for user `d7499c7d953346c79b8adf6b0557fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:30.712427 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-66f55137-b66e-4b06-afa0-5b82d476262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.767325 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1422/2826] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:30.777349 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:30.779078 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:30.839619 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c61779-10f1-4001-8d2e-42332c1e33d7 admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:30.843324 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:30.843966 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:30.844248 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:30.844527 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:30.853887 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:30.855336 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:30.864804 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1405/2827] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:32.030219 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7cd55-2d5a-46a6-9b5e-27d94fc887ae None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.030766 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7cd55-2d5a-46a6-9b5e-27d94fc887ae None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.030870 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7cd55-2d5a-46a6-9b5e-27d94fc887ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.060476 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-d2c7cd55-2d5a-46a6-9b5e-27d94fc887ae None None] MFA Rules not processed for user `00fb86d834c5405ea06e6c79ef712c25`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:32.061781 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-d2c7cd55-2d5a-46a6-9b5e-27d94fc887ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:32.125104 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1423/2828] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:32.135046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:32.136473 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:32.191267 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff357b-7529-4e5e-8b39-bf370165846f service neutron] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:32.195464 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65d84bc451c5469b89788e179bfc4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:32.196101 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:32.196379 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:32.196656 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:32.204810 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:32.206241 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:32.215549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1406/2829] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:32 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:33.955375 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] REQUEST_METHOD: `POST` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:33.955960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:33.955960 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:33.975526 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.auth.core [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] MFA Rules not processed for user `00fb86d834c5405ea06e6c79ef712c25`. Rule list: `[]` (Enabled: `True`). {{(pid=73793) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:24:33.977903 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:33.984075 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1424/2830] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:24:33 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:24:34.021282 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.022827 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.077793 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad56a48-cb62-417e-968b-ca255d64c6ab service cinder] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.081448 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f148f069b014ed5baa06b408bab5d1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.082124 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.082989 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.083270 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.085002 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.151745 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.153106 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.163994 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1407/2831] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:34.362240 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.372833 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60ec3-f2b6-45de-bc57-edf80af5bb12 None None] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.376404 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.377039 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.377322 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.377598 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.380505 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.389756 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.391213 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.399495 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1425/2832] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:34.841428 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.842902 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.847513 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:34.856628 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480e0e-095b-4a3b-a922-53cefe0e0681 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.860376 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.861129 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.861480 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.861831 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.864494 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.877976 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.879581 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.890816 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1426/2833] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:24:34.913503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20d30-45cb-46c0-b4a5-1cd51a357221 service glance] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:34.921977 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:34.923180 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:34.923512 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:34.923840 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:34.925778 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:34.940069 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:34.941765 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:34.951906 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1408/2834] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:34 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:37.713597 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:37.715045 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:37.725386 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32aaa-e41c-45ac-ad91-fb7b4359aefe service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:37.729041 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:37.729671 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:37.729956 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:37.730226 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:37.731932 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:37.741499 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:37.742964 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:37.750747 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1427/2835] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:46.218135 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:24:46.219634 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:46.234978 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d05bc-8dbe-49f7-b67b-c595ce0be2ff service placement] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:24:46.241113 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:24:46.243232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:24:46.243232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:24:46.243232 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:24:46.244005 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:24:46.255503 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:24:46.257046 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d889-6e94-42e4-bc17-c2b1815bc721 service nova] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:24:46.267660 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1409/2836] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:24:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:25:45.848115 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:25:45.889977 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb61aac-bbd8-467a-9f63-c374d276ab81 service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:25:45.895539 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb32cee436d24774b51fa67a73ef342d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:25:45.896177 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:25:45.896458 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:25:45.896731 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:25:45.898471 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:25:45.928904 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:25:45.930788 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:25:45.942661 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1428/2837] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:25:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:26:00.110080 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] REQUEST_METHOD: `POST` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.110658 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.110772 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.128950 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.auth.core [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] MFA Rules not processed for user `00fb86d834c5405ea06e6c79ef712c25`. Rule list: `[]` (Enabled: `True`). {{(pid=73792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:26:00.130153 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:00.136999 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1410/2838] 10.222.0.73 () {58 vars in 958 bytes} [Fri Aug 27 04:26:00 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:26:00.359074 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:26:00.378348 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295810a0-c26b-4e00-82c9-c04690f6fd7a service nova] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:26:00.381953 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40245bfc762a492587d3e4d39abea6b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:26:00.382619 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:26:00.382907 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:26:00.383182 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:26:00.384923 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:26:00.406349 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:26:00.407814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:26:00.415521 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1429/2839] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:26:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:27:17.542874 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:17.573870 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0052a2-992a-44eb-9645-93a96c4f40ef None None] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:17.578859 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:17.579774 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:17.580059 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:17.580328 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] PATH_INFO: `/v3/users/00fb86d834c5405ea06e6c79ef712c25` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:17.581680 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fb86d834c5405ea06e6c79ef712c25)` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:17.583684 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:17.785691 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fb86d834c5405ea06e6c79ef712c25'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:17.839549 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fb86d834c5405ea06e6c79ef712c25'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:17.851839 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fb86d834c5405ea06e6c79ef712c25'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:17.852521 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fb86d834c5405ea06e6c79ef712c25'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:17.853546 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.notifications [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fb86d834c5405ea06e6c79ef712c25'} {{(pid=73792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:17.865276 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1411/2840] 10.222.0.73 () {58 vars in 1224 bytes} [Fri Aug 27 04:27:17 2021] DELETE /identity/v3/users/00fb86d834c5405ea06e6c79ef712c25 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:27:18.096514 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:18.108563 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffe141-f9d6-46c1-ba82-b5dbf0a57e7c service neutron] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:18.162371 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7499c7d953346c79b8adf6b0557fa02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd619747d92dd4ce8a23a9280f1833108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:18.163263 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:18.163549 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:18.163826 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] PATH_INFO: `/v3/projects/acdf99bfe4454bd190356a3a79f0041f` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:18.164999 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdf99bfe4454bd190356a3a79f0041f)` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:18.167680 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:18.255715 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdf99bfe4454bd190356a3a79f0041f', 'request_id': 'req-6a09b42a-9af0-40af-a918-c664d4276cba'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:18.328571 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdf99bfe4454bd190356a3a79f0041f', 'request_id': 'req-6a09b42a-9af0-40af-a918-c664d4276cba'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:18.334384 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdf99bfe4454bd190356a3a79f0041f', 'request_id': 'req-6a09b42a-9af0-40af-a918-c664d4276cba'} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:18.358166 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] The token cache is being invalidate because project acdf99bfe4454bd190356a3a79f0041f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73793) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:27:18.358377 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:18.359014 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.notifications [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73793) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:27:18.360578 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1430/2841] 10.222.0.73 () {58 vars in 1233 bytes} [Fri Aug 27 04:27:18 2021] DELETE /identity/v3/projects/acdf99bfe4454bd190356a3a79f0041f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:27:50.092518 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Authenticating user token {{(pid=73792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:27:50.094439 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:50.181103 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056a59-ea2a-4160-90d0-dccf1e5cdd1f admin admin] Validating token access rules against request {{(pid=73792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:27:50.235591 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:27:50.236165 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] REQUEST_METHOD: `GET` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:50.236443 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] SCRIPT_NAME: `/identity` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:50.236716 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:50.238647 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.fernet_utils [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:27:50.249803 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:27:50.251404 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faf392-5eac-4b59-b314-5e4eb83e36ce service placement] RBAC: Authorization granted {{(pid=73792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:27:50.261072 dv-cinder-804757-2-iscsi devstack@keystone.service[73792]: [pid: 73792|app: 0|req: 1412/2842] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:27:50 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:32:53.079141 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Authenticating user token {{(pid=73793) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:53.080724 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.fernet_utils [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73793) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:53.095909 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b42a-9af0-40af-a918-c664d4276cba admin admin] Validating token access rules against request {{(pid=73793) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:53.100886 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8139a-2c5b-45ba-8b80-fef1707773df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b134c117c9843509b5e8fa587ab484e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '532150cfa2604bf898c920155cb970e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73793) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:53.101528 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8139a-2c5b-45ba-8b80-fef1707773df service placement] REQUEST_METHOD: `GET` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:53.101814 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8139a-2c5b-45ba-8b80-fef1707773df service placement] SCRIPT_NAME: `/identity` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:53.102090 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8139a-2c5b-45ba-8b80-fef1707773df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73793) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:53.110412 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8139a-2c5b-45ba-8b80-fef1707773df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:53.112019 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8139a-2c5b-45ba-8b80-fef1707773df service placement] RBAC: Authorization granted {{(pid=73793) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:53.122062 dv-cinder-804757-2-iscsi devstack@keystone.service[73793]: [pid: 73793|app: 0|req: 1431/2843] 10.222.0.73 () {60 vars in 1366 bytes} [Fri Aug 27 04:32:53 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)